-- Logs begin at Thu 2022-07-14 10:26:12 UTC, end at Thu 2022-07-14 11:44:40 UTC. -- Jul 14 11:07:52.635990 dv-cinder-822821-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:07:52 2022] *** Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: nodename: dv-cinder-822821-5-iscsi Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: machine: x86_64 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: clock source: unix Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: pcre jit disabled Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: detected number of CPU cores: 4 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: current working directory: / Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: your processes number limit is 47680 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: your memory page size is 4096 bytes Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: detected max file descriptor number: 2048 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: lock engine: pthread robust mutexes Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: thunder lock: enabled Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 11:07:52.646795 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:07:52.691115 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: Python main interpreter initialized at 0x5558356299c0 Jul 14 11:07:52.691115 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: python threads support enabled Jul 14 11:07:52.691115 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: your server socket listen backlog is limited to 100 connections Jul 14 11:07:52.691115 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:07:52.691493 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:07:52.691556 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: *** Operational MODE: preforking *** Jul 14 11:07:52.691797 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:07:52.691797 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: spawned uWSGI master process (pid: 103720) Jul 14 11:07:52.691986 dv-cinder-822821-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 11:07:52.692559 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: spawned uWSGI worker 1 (pid: 103721, cores: 1) Jul 14 11:07:52.692889 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: spawned uWSGI worker 2 (pid: 103722, cores: 1) Jul 14 11:07:52.693061 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:07:53.356847 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:07:53.368314 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:07:54.488985 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:07:54.488985 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: from cryptography.utils import int_from_bytes Jul 14 11:07:54.489678 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:07:54.489678 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: from cryptography.utils import int_from_bytes Jul 14 11:07:54.493812 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:07:54.493812 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: from cryptography.utils import int_from_bytes Jul 14 11:07:54.494243 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:07:54.494243 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: from cryptography.utils import int_from_bytes Jul 14 11:07:56.989731 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:07:56.990374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:07:56.990469 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:07:56.990826 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:07:56.991011 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:07:56.991407 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:07:56.991504 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:07:56.991599 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.991775 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.991914 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:07:56.992130 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.992296 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:07:56.992452 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:07:56.992644 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.992776 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.992861 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993043 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993141 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993356 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993450 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993668 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993767 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.993986 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994090 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994240 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994333 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994548 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994641 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994865 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-5-iscsi {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.994950 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.995207 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.995294 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.995468 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.995550 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.995782 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.995874 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996094 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996182 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-5-iscsi {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996398 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996489 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996700 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996783 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.996997 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.997078 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.997308 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.997482 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.997595 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.998770 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.998979 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.999171 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.999321 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.999547 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.999696 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:56.999930 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.000078 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.000254 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.000475 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.000658 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.000811 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.000985 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.001158 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.001364 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.001548 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.001703 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.001876 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.002086 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.002240 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.002455 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-5-iscsi {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.002643 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.002796 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003004 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003200 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003391 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003547 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003698 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-5-iscsi {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003849 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.003981 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004109 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004263 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004399 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004537 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004665 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004787 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.004939 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005061 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005193 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005322 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005448 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005569 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005688 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005809 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.005942 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006064 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006293 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006424 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006552 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006680 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006809 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.006931 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.007051 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.007196 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.007334 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.007465 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.008085 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.008268 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.008475 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.008691 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009162 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009328 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009458 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009586 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009707 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009836 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.009968 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010105 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010226 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010351 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010470 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010590 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010786 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.010912 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011039 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011205 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011330 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011451 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011451 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011732 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011732 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.011967 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012078 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012193 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012305 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012414 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012521 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012649 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012770 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.012902 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013030 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013164 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013285 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013405 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013530 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013659 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013780 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.013900 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014018 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014138 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014270 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014392 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014517 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014645 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014645 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014891 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.014891 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015141 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015276 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015398 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015527 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015649 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015781 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.015903 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016022 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016141 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016278 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016408 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016537 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016657 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016832 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.016956 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.017129 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.017265 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.017435 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.017559 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.017737 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.017858 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018041 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018173 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018343 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018468 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018587 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018705 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018862 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.018994 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.019178 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.019315 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.019491 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.019623 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.019789 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.019920 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020087 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020227 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020385 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020510 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020678 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020809 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.020978 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021101 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021273 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021396 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021571 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021696 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021868 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.021991 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.022165 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.022290 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.022461 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.022587 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.022758 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.022880 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.023052 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.023210 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024048 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024263 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024449 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024584 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024715 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024846 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.024977 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.025098 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.025292 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.025416 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.025614 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.025746 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.025912 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026042 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026214 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026343 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026514 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026636 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026814 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.026948 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.027144 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.027269 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.027456 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.027590 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.027755 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.027886 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028069 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028193 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028491 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028666 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028792 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.028978 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.029100 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.029271 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.029402 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.029572 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.029706 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.029882 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030005 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030178 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030312 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030473 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030595 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030771 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.030906 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031067 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031221 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031395 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031516 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031691 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031813 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.031989 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032122 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032286 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032407 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032576 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032704 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032873 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.032996 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.033174 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.033304 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.033469 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.033592 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.033768 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.033890 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.034066 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.034203 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.034374 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.034496 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.034675 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.034805 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.034975 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.035099 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.035316 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:07:57.035452 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.035647 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.035771 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.035972 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.036102 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.036297 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.036493 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.036623 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.036743 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.036904 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037033 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037210 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037348 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037537 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037661 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037841 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.037964 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.038146 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.038287 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.038452 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.038575 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.038762 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.038884 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.039102 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.039335 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.039554 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.039686 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.039829 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.039964 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040099 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040234 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040356 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040507 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040624 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040822 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.040946 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.041138 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.041263 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.041454 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.041580 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.041770 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.041903 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.042085 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.042211 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.042414 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.042546 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.042732 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.042864 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043042 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043193 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043389 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043512 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043697 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043829 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.043999 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.044123 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.044304 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.044428 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.044622 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.044748 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.044946 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045071 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045251 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045373 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045557 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045683 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045862 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.045992 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.046167 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.046291 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.046471 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.046597 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.046777 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.046902 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.047083 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.047269 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.047404 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.047526 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.047711 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.047835 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048019 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048143 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048328 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048459 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048660 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048784 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.048973 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.049109 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.049288 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.049411 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.049592 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.049721 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.049892 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050032 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050190 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050314 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050489 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050624 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050791 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.050928 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.051089 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.051232 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.051420 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.051553 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.051724 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.051858 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052026 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052149 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052326 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052455 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052639 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052763 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.052944 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053068 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053247 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053378 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053551 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053676 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053849 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.053974 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.054153 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.054277 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.054473 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.055082 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.055681 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.055681 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.055681 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.055681 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056140 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056263 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056383 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056503 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056623 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056743 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056871 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.056999 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.057127 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.057250 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.057439 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.057572 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.057747 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.057870 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058052 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058177 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058370 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058506 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058674 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058797 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.058977 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.059107 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.059330 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.059532 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.059657 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.059784 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.059941 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.060073 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.060259 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.060386 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.060577 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.060702 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.060886 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061019 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061182 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061306 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061484 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061608 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061782 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.061907 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062081 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062207 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062380 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062512 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062683 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062813 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.062979 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.063112 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.063373 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.063509 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.063675 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.063811 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.063972 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.064103 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.064272 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.064396 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.064573 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.064705 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.064877 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065011 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065172 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065294 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065467 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065601 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065763 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.065895 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066063 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066186 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066367 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066500 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066672 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066796 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.066994 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.067242 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.067382 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.067506 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.067633 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.067756 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.067905 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068046 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068207 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068332 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068530 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068653 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068836 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.068959 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.069140 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.069272 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.069493 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.069752 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.069876 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.070568 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.070734 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.070926 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.071152 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.071348 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.071479 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.071601 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.071735 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.071907 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072032 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072216 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072340 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072525 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072656 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072842 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.072967 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.073158 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.073281 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.073475 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.073600 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.073783 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.073908 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.074103 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.074225 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.074409 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.074543 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.074710 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.074840 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.075015 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.075162 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.075344 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.075467 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.075770 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076017 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076139 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076269 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076390 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076573 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076699 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076818 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.076946 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.077124 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.077250 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.077426 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.077550 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.077743 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.077875 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.078046 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.078179 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.078459 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.078592 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.078713 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.078833 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.079037 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.079500 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.079647 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.079852 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.079959 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080062 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080174 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080279 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080382 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080491 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080594 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080705 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080872 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.080982 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.081173 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.081282 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.081478 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.081597 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.081778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.081888 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082077 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082187 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082380 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082500 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082687 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082805 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.082990 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.083101 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.083318 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.086997 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087161 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087250 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087328 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087418 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087506 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087585 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087661 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087737 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087813 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087888 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.087972 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088057 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088135 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088210 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088286 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088368 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088454 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088532 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088532 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088671 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088671 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088807 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088891 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.088969 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089044 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089120 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089203 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089293 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089379 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089456 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089533 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089613 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089689 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089838 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089918 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.089994 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090070 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090154 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090231 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090316 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090394 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090470 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090643 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090779 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.090912 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091052 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091214 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091348 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091522 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091656 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091827 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.091930 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.092141 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.092233 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.092450 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.092538 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.092753 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.092860 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093057 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093144 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093366 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093507 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093662 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093793 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.093957 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.094179 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.094323 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.094459 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.094661 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.094816 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.094960 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.095093 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.095287 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.095449 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.095593 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.095744 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.095879 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.096021 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.096185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.096335 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.096479 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.096804 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.096954 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.097096 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.097228 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.097404 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.097553 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.097701 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.097842 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098001 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098150 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098301 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098435 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098610 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098750 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.098961 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.099194 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.099341 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.099557 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.099716 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.099862 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100005 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100181 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100332 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100500 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100650 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100793 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.100933 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.101074 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.101223 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.101412 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.101628 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.101831 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.102069 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.102315 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.102475 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.102622 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.102758 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.102891 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103025 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103176 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103326 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103471 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103614 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103748 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.103881 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104026 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104169 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104310 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104445 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104578 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104754 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.104904 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105038 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105179 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105340 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105490 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105624 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105776 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.105918 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106066 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106232 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106378 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106524 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106664 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106832 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.106973 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.107176 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.107322 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.107479 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.107620 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.107776 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.107926 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108060 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108193 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108368 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108508 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108651 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108784 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.108951 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109101 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109243 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109394 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109538 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109683 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109826 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.109975 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.110186 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.110337 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.110481 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.110613 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.110782 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.110929 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111085 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111254 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111406 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111556 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111702 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111836 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.111969 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.112110 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.112253 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.112395 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.112537 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.112669 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.112892 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113029 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113163 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113304 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113454 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113589 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113738 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.113889 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114024 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114158 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114299 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114432 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114573 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114708 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114850 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.114993 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.115157 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.115319 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.115463 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.115598 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.115732 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.115880 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116031 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116182 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116325 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116458 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116599 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116739 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.116873 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.117049 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.117292 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.117513 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.117673 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.117817 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.117966 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118119 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118254 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118396 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118529 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118662 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118795 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.118937 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119074 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119270 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119414 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119547 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119701 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119846 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.119979 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120113 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120246 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120379 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120529 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120664 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120813 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.120966 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121107 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121257 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121401 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121540 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121688 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121821 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.121969 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122103 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122246 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122389 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122522 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122663 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122815 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.122962 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123098 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123254 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123400 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123535 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123668 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123810 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.123945 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124086 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124220 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124355 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124488 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124639 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124781 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.124916 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125057 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125191 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125332 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125475 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125617 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125776 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.125955 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.126095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.126249 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.126385 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.126558 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.126707 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.126863 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127003 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127194 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127338 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127489 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127624 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127757 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.127896 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128064 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128212 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128355 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128507 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128649 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128781 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.128923 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.129096 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.129236 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.129403 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.129543 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.129699 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.129842 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130007 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130148 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130291 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130432 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130607 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130758 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.130914 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131062 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131229 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131373 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131522 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131673 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131811 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.131952 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.132124 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.132275 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.132422 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.133056 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.133229 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.133468 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.133709 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134124 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134124 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134394 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134527 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134661 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134799 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.134941 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135095 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135293 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135428 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135562 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135703 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135850 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.135993 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136127 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136268 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136401 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136534 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136688 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136831 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.136977 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137111 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137260 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137402 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137544 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137679 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137811 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.137945 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.138079 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.138255 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.138411 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.138562 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.138713 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.138861 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139003 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139187 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139329 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139463 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139604 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139737 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.139870 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140012 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140148 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140323 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140465 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140617 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140751 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.140959 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.141105 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.141330 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.141480 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.141623 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.141765 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.141932 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142073 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142237 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142389 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142522 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142686 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142828 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.142971 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.143115 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.143304 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.143446 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.143589 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.143732 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.143865 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144014 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144158 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144302 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144444 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144595 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144738 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.144871 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145027 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145282 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145431 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145580 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145723 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145863 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.145997 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.146210 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.146352 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.146497 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.146639 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.146780 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.146913 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.147085 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.147284 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.147428 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.147563 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.147718 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.147859 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.148037 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.148247 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.148943 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.149180 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.149412 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.149619 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.149759 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.149893 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150026 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150160 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150310 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150477 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150629 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150773 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.150924 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151066 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151259 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151360 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151447 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151611 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151697 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151817 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.151907 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.152130 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.152278 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.152435 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.152598 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.152755 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.152900 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153076 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153213 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153381 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153529 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153690 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153826 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.153996 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.154160 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.154313 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.154458 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.154626 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.154768 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.154921 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.155063 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.155268 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.155410 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.155587 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.155726 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.155872 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156015 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156165 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156306 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156462 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156744 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.156898 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.157125 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.157274 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.157444 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.157585 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.157728 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.157864 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158042 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158189 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158344 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158484 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158656 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158804 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.158948 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.159081 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.159280 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.159438 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.159590 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.159725 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.159880 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160036 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160171 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160303 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160453 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160595 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160747 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.160888 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161062 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161209 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161352 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161494 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161664 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161812 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.161981 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.162143 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.162288 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.162423 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.162588 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.162739 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.162906 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.163055 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.163263 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.163399 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.163532 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.163664 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.163797 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.164115 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.164348 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.164521 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.164521 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.164785 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.164943 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165232 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165365 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165498 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165639 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165782 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.165926 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166068 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166209 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166343 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166484 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166638 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166781 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.166915 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167056 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167222 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167334 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167419 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167624 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167714 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.167940 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168036 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168241 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168330 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168536 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168631 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168839 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.168937 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.169136 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.169232 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.169436 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.169523 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.169742 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.169828 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170043 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170130 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170343 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170436 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170641 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170740 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.170961 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171049 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171283 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171383 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171601 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171698 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171905 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.171990 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.172205 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.172314 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.172510 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.172623 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.172809 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.172898 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.173149 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.173235 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.173456 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.173569 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.173777 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.173939 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174080 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174215 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174361 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174512 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174677 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174828 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.174988 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.175181 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.175332 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.175533 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.175682 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.175854 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.175996 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.176164 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.176318 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.176475 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.176610 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.176766 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.176915 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.177074 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.177224 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.177381 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.177521 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.177674 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.177883 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.178031 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.178786 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.178947 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.179107 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.179274 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.179454 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.179618 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.179869 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.180133 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.180133 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.180403 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.180615 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.180754 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.180889 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181037 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181177 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181319 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181470 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181615 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181751 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181890 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.181890 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.182160 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.182301 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.182529 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.182529 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.182803 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.182939 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183092 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183275 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183412 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183563 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183706 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183853 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.183998 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.184134 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.184268 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.184409 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.184563 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.184712 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.184871 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185013 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185164 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185306 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185454 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185604 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185747 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.185890 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186031 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186171 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186330 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186472 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186613 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186753 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.186900 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187047 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187222 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187375 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187517 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187657 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187797 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.187797 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188104 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188257 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188399 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188546 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188687 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188841 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.188993 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.189141 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.189283 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.189424 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.189572 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.189726 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.189868 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190020 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190162 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190309 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190451 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190600 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.190907 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191049 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191209 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191364 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191364 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191633 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191773 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.191922 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192064 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192212 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192355 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192524 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192672 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192813 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.192953 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193102 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193244 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193385 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193528 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193683 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193832 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.193981 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.194130 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.194271 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.194412 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.194566 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.194723 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.194872 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.195014 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.195715 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.195859 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.195971 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196070 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196144 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196366 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196681 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196802 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.196990 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.197089 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.197392 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.197523 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.197693 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.197870 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198002 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198203 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198295 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198512 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198615 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198833 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.198923 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.199163 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.199331 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.199475 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.199615 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.199770 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.199921 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200062 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200214 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200363 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200512 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200662 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200811 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.200962 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201103 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201244 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201385 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201545 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201689 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201829 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.201983 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202124 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202273 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202414 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202555 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202702 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202851 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.202994 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.203210 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.203359 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.203499 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.203647 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.203795 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.203948 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204099 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204249 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204396 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204537 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204816 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.204965 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205116 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205265 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205407 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205547 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205695 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205847 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.205988 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206136 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206279 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206418 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206566 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206708 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206848 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.206995 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.207159 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.207307 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.207460 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.207600 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.207752 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.207899 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.208041 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.208208 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.208454 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.208601 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.208743 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.208882 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209022 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209171 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209314 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209454 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209604 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209746 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.209886 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.210035 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.210185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.210328 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.210476 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.210616 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.210827 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.211627 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.211868 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212092 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212243 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212399 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212552 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212704 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212845 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.212993 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.213135 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.213275 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.213424 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.213576 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.213725 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.213873 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214015 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214157 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214321 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214463 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214606 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214745 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.214886 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215026 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215196 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215344 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215513 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215662 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215803 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.215951 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216109 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216251 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216391 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216537 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216680 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216828 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.216978 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.217118 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.217258 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.217398 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.217561 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.217719 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.217870 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218026 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218167 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218314 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218466 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218608 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218750 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.218897 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219061 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219251 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219407 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219549 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219690 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219847 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.219988 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.220129 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.220282 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.220424 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.220593 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.220749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.220899 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221048 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221200 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221350 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221502 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221654 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221795 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.221944 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.222087 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.222230 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.222369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.222517 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.222668 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.222822 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.223079 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.223230 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.223421 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.223525 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.223738 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.223829 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224036 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224124 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224340 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224436 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224652 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224742 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.224954 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225052 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225250 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225337 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225548 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225635 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225850 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.225936 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.226147 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.226233 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.226483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.226631 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.226864 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.226951 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.227189 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.227296 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.227496 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.227583 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.227793 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.227879 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228092 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228189 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228391 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228490 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228687 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228840 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.228988 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229091 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229285 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229372 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229584 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229673 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229881 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.229976 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.230177 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.230274 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.230471 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.230558 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.230765 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.230853 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.231060 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.231161 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.231406 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.231504 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.231709 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.231797 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232009 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232096 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232308 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232403 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232609 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232704 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.232908 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233010 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233210 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233318 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233515 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233603 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233814 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.233900 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.234113 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.234208 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.234411 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.234498 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.234710 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.234797 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235008 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235106 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235341 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235428 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235645 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235731 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.235948 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236049 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236253 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236342 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236559 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236646 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236874 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.236962 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.237178 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.237266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.237477 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.237563 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.237796 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.237885 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.238106 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.238190 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.238423 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.238566 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.238718 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.238806 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239027 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239144 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239372 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239469 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239674 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239811 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.239979 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240074 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240282 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240379 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240585 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240672 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240888 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.240982 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.241194 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.241291 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.241496 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.241583 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.241800 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.241889 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.242139 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.242228 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.242456 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.242703 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.242847 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.242935 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.243211 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.243343 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.243505 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.243605 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.243824 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.243920 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.244144 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.244232 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.244449 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.244534 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.244760 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.244847 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245071 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245167 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245385 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245472 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245693 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245793 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.245995 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.246082 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.246292 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.246378 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.246527 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:07:57.246627 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.246917 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.247277 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.247588 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.247912 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.248236 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.248576 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.248885 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.249227 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.249551 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.249864 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.250175 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.250477 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:07:57.250715 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:07:57.309208 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Registered counter for database nova_api Jul 14 11:07:57.313185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Registered counter for database nova_api Jul 14 11:07:57.423876 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.425831 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.431103 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.433387 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.488384 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.context [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35b895b2-8a39-4db8-bdc4-5ba8397f943e(cell1) {{(pid=103721) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:07:57.489550 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.context [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35b895b2-8a39-4db8-bdc4-5ba8397f943e(cell1) {{(pid=103722) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:07:57.492434 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.493955 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.494134 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.494940 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.495808 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.496678 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:07:57.497092 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.498936 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:07:57.499094 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Registered counter for database nova_cell0 Jul 14 11:07:57.501027 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Registered counter for database nova_cell0 Jul 14 11:07:57.503003 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Registered counter for database nova_cell1 Jul 14 11:07:57.504890 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Registered counter for database nova_cell1 Jul 14 11:07:57.510912 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.512408 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.514879 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.516497 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.518925 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.521040 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.521996 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.525202 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.668671 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Registered counter for database nova_cell0 Jul 14 11:07:57.671161 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Registered counter for database nova_cell0 Jul 14 11:07:57.677574 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.681899 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:07:57.682968 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:57.686424 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:07:58.098057 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:07:58.106082 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:07:58.128114 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:07:58.135771 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:07:58.451976 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:07:58.457905 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:07:58.463194 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558356299c0 pid: 103721 (default app) Jul 14 11:07:58.465263 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:07:58.466467 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 Jul 14 11:07:58.466873 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Thu Jul 14 11:07:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:07:58.479605 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:07:58.485629 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-70730f42-16d0-43e7-ba11-1e1762ce5407 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:07:58.490795 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558356299c0 pid: 103722 (default app) Jul 14 11:09:17.427947 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:17.429307 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Jul 14 11:09:17.429968 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:17.442175 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:17.443018 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell1:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:17.443867 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:17.444933 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:18.323169 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-89f353b8-0c2b-4c73-af41-5bf11e01f3b1 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:18.355137 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-89f353b8-0c2b-4c73-af41-5bf11e01f3b1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918319 Jul 14 11:09:18.355912 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jul 14 11:09:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:20.598645 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:20.599885 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-277751a9-e0e8-468f-a03d-42cbbef60952 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002286 Jul 14 11:09:20.600276 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:21.042144 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8640a28c-5e0b-4c45-897a-55db26690ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "disk": 1, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:21.060643 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:09:21.060643 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 11:09:21.144331 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8640a28c-5e0b-4c45-897a-55db26690ed5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.537988 Jul 14 11:09:21.145482 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:21.159383 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:21.160411 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell1:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:21.161653 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:21.162477 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:21.368331 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5a403e4f-b0f3-4082-95be-ceab5d7786f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:21.370725 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:09:21.370725 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 11:09:21.494027 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-5a403e4f-b0f3-4082-95be-ceab5d7786f3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.340124 Jul 14 11:09:21.507154 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jul 14 11:09:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:23.778564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8640a28c-5e0b-4c45-897a-55db26690ed5 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:23.779671 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8640a28c-5e0b-4c45-897a-55db26690ed5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jul 14 11:09:23.780266 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:24.450240 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-b1f9bbab-d7fa-470c-aefd-972a88ecf57a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "swap": 0, "id": "d1", "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:24.471859 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:09:24.471859 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 11:09:24.568881 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-b1f9bbab-d7fa-470c-aefd-972a88ecf57a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781644 Jul 14 11:09:24.570237 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:24.582481 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-92344736-2642-4ef9-a2ef-7dbf3e46b3be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:24.584257 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:09:24.584257 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 11:09:24.699248 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-92344736-2642-4ef9-a2ef-7dbf3e46b3be admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120677 Jul 14 11:09:24.700081 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jul 14 11:09:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:26.958384 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-b1f9bbab-d7fa-470c-aefd-972a88ecf57a admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:26.959454 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-b1f9bbab-d7fa-470c-aefd-972a88ecf57a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 14 11:09:26.959856 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:27.361232 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-17286acf-a672-4c93-8d77-8ff6a1863837 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:27.414435 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-17286acf-a672-4c93-8d77-8ff6a1863837 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448809 Jul 14 11:09:27.414973 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:27.427934 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-29bc2f96-35a2-496f-867c-a8c09cfa685c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:27.486141 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-29bc2f96-35a2-496f-867c-a8c09cfa685c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063150 Jul 14 11:09:27.486705 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jul 14 11:09:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:29.696419 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-17286acf-a672-4c93-8d77-8ff6a1863837 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:29.698133 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-17286acf-a672-4c93-8d77-8ff6a1863837 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Jul 14 11:09:29.699099 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:30.111966 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-96ac93b5-5399-491a-862c-8b7b9b726352 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:30.202323 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-96ac93b5-5399-491a-862c-8b7b9b726352 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495947 Jul 14 11:09:30.203318 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:30.216979 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-2b6f20d3-9931-456e-b19f-2792257723aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:30.303963 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-2b6f20d3-9931-456e-b19f-2792257723aa admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091444 Jul 14 11:09:30.304605 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jul 14 11:09:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:32.549048 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-96ac93b5-5399-491a-862c-8b7b9b726352 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:32.550069 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-96ac93b5-5399-491a-862c-8b7b9b726352 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 14 11:09:32.550478 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:32.977427 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-c6aba64e-9203-4f09-acaa-fdce7c9492d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "swap": 0, "ram": 4096, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:33.066531 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-c6aba64e-9203-4f09-acaa-fdce7c9492d7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510009 Jul 14 11:09:33.068279 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:33.082232 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-daff840f-26da-4675-a371-e8b58dc67f34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:33.170782 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-daff840f-26da-4675-a371-e8b58dc67f34 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094156 Jul 14 11:09:33.171574 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Thu Jul 14 11:09:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:35.448527 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-c6aba64e-9203-4f09-acaa-fdce7c9492d7 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:35.449466 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-c6aba64e-9203-4f09-acaa-fdce7c9492d7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 14 11:09:35.449867 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:35.853583 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-1ce80ffa-984f-48f1-a571-06c86144b3cd admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:35.877487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-1ce80ffa-984f-48f1-a571-06c86144b3cd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.421188 Jul 14 11:09:35.878021 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jul 14 11:09:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:09:38.091292 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-c6aba64e-9203-4f09-acaa-fdce7c9492d7 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:38.092275 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-c6aba64e-9203-4f09-acaa-fdce7c9492d7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 14 11:09:38.092672 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:38.537116 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-022a4c7e-70d0-4ef2-b108-f69ba94693a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:38.612187 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-022a4c7e-70d0-4ef2-b108-f69ba94693a1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.513781 Jul 14 11:09:38.612745 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:09:38.628499 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-f0774689-4cf6-4b3a-b566-2e82aa8f8de6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:38.726559 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-f0774689-4cf6-4b3a-b566-2e82aa8f8de6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102816 Jul 14 11:09:38.727059 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jul 14 11:09:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:40.945406 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-022a4c7e-70d0-4ef2-b108-f69ba94693a1 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:40.946420 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-022a4c7e-70d0-4ef2-b108-f69ba94693a1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 14 11:09:40.946817 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:41.352663 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-cf592a4e-633e-46e8-a447-b4569bdfdc2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:41.441643 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-cf592a4e-633e-46e8-a447-b4569bdfdc2e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488914 Jul 14 11:09:41.442317 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:41.454031 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-440f71d8-2b22-4d5b-b9f4-683e29bbc4ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:41.565537 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-440f71d8-2b22-4d5b-b9f4-683e29bbc4ce admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115006 Jul 14 11:09:41.566109 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jul 14 11:09:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:43.809774 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-cf592a4e-633e-46e8-a447-b4569bdfdc2e admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:43.810675 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-cf592a4e-633e-46e8-a447-b4569bdfdc2e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 14 11:09:43.811087 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:44.225149 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5521d9f1-6877-4236-a444-91a5b6533361 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:44.297916 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-5521d9f1-6877-4236-a444-91a5b6533361 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.480126 Jul 14 11:09:44.298669 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:44.310986 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-bec8ea8f-8ce7-4490-9589-c2c0f01df976 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:44.371302 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-bec8ea8f-8ce7-4490-9589-c2c0f01df976 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063937 Jul 14 11:09:44.372248 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jul 14 11:09:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:09:46.636083 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5521d9f1-6877-4236-a444-91a5b6533361 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:46.637099 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-5521d9f1-6877-4236-a444-91a5b6533361 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 14 11:09:46.637497 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:47.135170 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ac490559-8cc3-41b1-97e3-6577d74919bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:47.228902 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-ac490559-8cc3-41b1-97e3-6577d74919bf admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.585544 Jul 14 11:09:47.229454 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:47.243789 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e87f93ba-38b8-4026-aff6-873f70ccefe7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:47.929596 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e87f93ba-38b8-4026-aff6-873f70ccefe7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.690154 Jul 14 11:09:47.930304 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jul 14 11:09:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:09:50.246173 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ac490559-8cc3-41b1-97e3-6577d74919bf admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:09:50.247201 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-ac490559-8cc3-41b1-97e3-6577d74919bf admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 14 11:09:50.247597 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:09:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:09:50.683957 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-3b744a21-7039-404e-b053-83676a55f78c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "swap": 0, "id": "5"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:50.757152 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-3b744a21-7039-404e-b053-83676a55f78c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.503615 Jul 14 11:09:50.758041 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Thu Jul 14 11:09:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:09:50.770601 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-39f4c4a4-7356-4e40-90d8-aa9b1d7331d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:09:50.774584 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:50.833886 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-39f4c4a4-7356-4e40-90d8-aa9b1d7331d3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067196 Jul 14 11:09:50.834727 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Thu Jul 14 11:09:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:10:11.278077 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-3b744a21-7039-404e-b053-83676a55f78c admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:11.279135 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-3b744a21-7039-404e-b053-83676a55f78c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 14 11:10:11.279551 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:10:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:11.667642 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8d4a59d7-e2c1-4d00-8b22-378f123d31e2 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:11.685188 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8d4a59d7-e2c1-4d00-8b22-378f123d31e2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399074 Jul 14 11:10:11.685725 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jul 14 11:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:12.750263 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-3b744a21-7039-404e-b053-83676a55f78c admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:12.751309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-3b744a21-7039-404e-b053-83676a55f78c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 14 11:10:12.751702 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:13.276430 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ecc9cc4b-e1d4-4002-b6ba-d217f63c7189 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:13.281994 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-ecc9cc4b-e1d4-4002-b6ba-d217f63c7189 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ecc9cc4b-e1d4-4002-b6ba-d217f63c7189 admin admin] Request method failure captured: Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Accept: application/json Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Connection: keep-alive Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Content-Length: 0 Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Host: 10.222.0.59 Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.90 Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABiz_mUAnhdnfr5zTM_873XT9pQGwSKR_WkufcqOLhi3zT7nGfAqF-JEGtK2eywOwkrjXCuS9lBnApuTer0HvQRnB0Mg0mcjaJw5rnFpRgCWiUaZqWOLSyi5-x_Xr1JuPSfXGiXvgmT3pXoc_iJZuvBxuKwBDAir0Vd41xjNFG4taSjjYM Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Role: member,reader,admin Jul 14 11:10:13.285716 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Roles: member,reader,admin Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7da05e4cf2b444729a9cbe3b6d5db535", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant: admin Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User: admin Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Id: 23fec8c4e37c41799ff49ae249e16e30 Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Name: admin Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: method: > Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: exception: Flavor 42 could not be found. Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: action_args: {'id': '42'} Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:13.287369 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:13.288239 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.289564 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ecc9cc4b-e1d4-4002-b6ba-d217f63c7189 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:13.290864 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-ecc9cc4b-e1d4-4002-b6ba-d217f63c7189 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397033 Jul 14 11:10:13.290864 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jul 14 11:10:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:13.296785 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-2f944b66-ada8-4278-b968-55a7dc65befd admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:13.299948 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:13.319388 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-2f944b66-ada8-4278-b968-55a7dc65befd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026049 Jul 14 11:10:13.319938 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jul 14 11:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:13.331382 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-3727a46f-8e9f-4ca5-8c51-b55dd78632c3 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:13.353146 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-3727a46f-8e9f-4ca5-8c51-b55dd78632c3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026701 Jul 14 11:10:13.353703 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jul 14 11:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:13.364759 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e26a0f4a-0032-4156-b5bc-ab6d41f68566 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:13.371005 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-e26a0f4a-0032-4156-b5bc-ab6d41f68566 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e26a0f4a-0032-4156-b5bc-ab6d41f68566 admin admin] Request method failure captured: Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Host: 10.222.0.59 Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABiz_mUAnhdnfr5zTM_873XT9pQGwSKR_WkufcqOLhi3zT7nGfAqF-JEGtK2eywOwkrjXCuS9lBnApuTer0HvQRnB0Mg0mcjaJw5rnFpRgCWiUaZqWOLSyi5-x_Xr1JuPSfXGiXvgmT3pXoc_iJZuvBxuKwBDAir0Vd41xjNFG4taSjjYM Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Role: member,reader,admin Jul 14 11:10:13.374374 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Roles: member,reader,admin Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7da05e4cf2b444729a9cbe3b6d5db535", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Id: 23fec8c4e37c41799ff49ae249e16e30 Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: method: > Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: exception: Flavor 42 could not be found. Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: action_args: {'id': '42'} Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:13.375866 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:13.381195 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:13.382300 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e26a0f4a-0032-4156-b5bc-ab6d41f68566 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:13.383450 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e26a0f4a-0032-4156-b5bc-ab6d41f68566 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015583 Jul 14 11:10:13.383450 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jul 14 11:10:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:14.349802 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-3727a46f-8e9f-4ca5-8c51-b55dd78632c3 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:14.350807 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-3727a46f-8e9f-4ca5-8c51-b55dd78632c3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 14 11:10:14.351225 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:14.878986 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-219e488c-74a0-42e4-992d-1476ef8c5c24 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:14.884378 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-219e488c-74a0-42e4-992d-1476ef8c5c24 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-219e488c-74a0-42e4-992d-1476ef8c5c24 admin admin] Request method failure captured: Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Host: 10.222.0.59 Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABiz_mWcCAnC41g_kgPRH7WLgNJZ-fY21f3rwxCE4BQGiqpQ8Hcbg1vN2Niu-yV58tbNeEgr6Yds2Yh8JiseTUpC3p9o7CatNJ2Q5DH3KlGN4ncQ9QaWgw4-XWLEKd1Wj6dxCy7Skgmqb4lreaMPSdXngCB1I8lwmGBBpNPCWaBobwP44U Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Role: member,reader,admin Jul 14 11:10:14.885883 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Roles: member,reader,admin Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7da05e4cf2b444729a9cbe3b6d5db535", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Id: 23fec8c4e37c41799ff49ae249e16e30 Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: method: > Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: exception: Flavor 84 could not be found. Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: action_args: {'id': '84'} Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:14.887487 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:14.888483 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.889767 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-219e488c-74a0-42e4-992d-1476ef8c5c24 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:14.890982 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-219e488c-74a0-42e4-992d-1476ef8c5c24 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396627 Jul 14 11:10:14.890982 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jul 14 11:10:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:14.896946 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-3967a5b2-ea64-4cd1-aec9-e2fe20013c14 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:14.910882 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-3967a5b2-ea64-4cd1-aec9-e2fe20013c14 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017472 Jul 14 11:10:14.911432 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jul 14 11:10:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:14.920790 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-003fdcf6-1f01-457a-8fab-1bcab28812cd admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:14.934823 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-003fdcf6-1f01-457a-8fab-1bcab28812cd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017616 Jul 14 11:10:14.935359 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jul 14 11:10:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:14.944437 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-0c001b03-c328-4761-b797-32f28efbe00c admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:14.949616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-0c001b03-c328-4761-b797-32f28efbe00c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-0c001b03-c328-4761-b797-32f28efbe00c admin admin] Request method failure captured: Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Accept: application/json Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Connection: keep-alive Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Content-Length: 0 Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Host: 10.222.0.59 Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.90 Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABiz_mWcCAnC41g_kgPRH7WLgNJZ-fY21f3rwxCE4BQGiqpQ8Hcbg1vN2Niu-yV58tbNeEgr6Yds2Yh8JiseTUpC3p9o7CatNJ2Q5DH3KlGN4ncQ9QaWgw4-XWLEKd1Wj6dxCy7Skgmqb4lreaMPSdXngCB1I8lwmGBBpNPCWaBobwP44U Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Role: member,reader,admin Jul 14 11:10:14.951095 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Roles: member,reader,admin Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7da05e4cf2b444729a9cbe3b6d5db535", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant: admin Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User: admin Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Id: 23fec8c4e37c41799ff49ae249e16e30 Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Name: admin Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: method: > Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: exception: Flavor 84 could not be found. Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: action_args: {'id': '84'} Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:14.952603 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:14.953542 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:14.954791 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-0c001b03-c328-4761-b797-32f28efbe00c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:14.956692 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-0c001b03-c328-4761-b797-32f28efbe00c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011444 Jul 14 11:10:14.956692 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Thu Jul 14 11:10:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:15.928158 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-003fdcf6-1f01-457a-8fab-1bcab28812cd admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:15.929161 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-003fdcf6-1f01-457a-8fab-1bcab28812cd admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 14 11:10:15.929552 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:16.448481 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-154620ad-3f3b-48df-8403-5f7fbebdca9b admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:16.454116 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-154620ad-3f3b-48df-8403-5f7fbebdca9b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-154620ad-3f3b-48df-8403-5f7fbebdca9b admin admin] Request method failure captured: Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Accept: application/json Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Connection: keep-alive Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Content-Length: 0 Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Host: 10.222.0.59 Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.90 Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABiz_mX2e1XiyjAxB7icXI4AUvtfhnO5dEfNJbnRpS_nBeRcXNn77gPEIJ5lBs4-dwqO1Le6uGjdeSwtssxVqZxi37InusQZxd2n6oErVU3rS6LnrZZ-rn875bftbETfx9IUAQcvKU7VSJjfR0DxT0LeKLqCntRjRFytEbA-7ZwEGAApPU Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Role: member,reader,admin Jul 14 11:10:16.456185 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Roles: member,reader,admin Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7da05e4cf2b444729a9cbe3b6d5db535", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant: admin Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User: admin Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Id: 23fec8c4e37c41799ff49ae249e16e30 Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: X-User-Name: admin Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: method: > Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: exception: Flavor 451 could not be found. Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: action_args: {'id': '451'} Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:16.457677 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:16.458616 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.459911 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-154620ad-3f3b-48df-8403-5f7fbebdca9b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:16.461186 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-154620ad-3f3b-48df-8403-5f7fbebdca9b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386837 Jul 14 11:10:16.461186 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jul 14 11:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:16.467064 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-c8a62393-4aa5-43ca-b8e4-b0cfe7876b5b admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:16.481262 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-c8a62393-4aa5-43ca-b8e4-b0cfe7876b5b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017725 Jul 14 11:10:16.481774 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jul 14 11:10:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:16.490986 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:16.505852 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018301 Jul 14 11:10:16.506365 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Thu Jul 14 11:10:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:10:16.515315 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-253d107c-6e11-4ba5-9b62-322c30131650 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:16.521263 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-253d107c-6e11-4ba5-9b62-322c30131650 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-253d107c-6e11-4ba5-9b62-322c30131650 admin admin] Request method failure captured: Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Host: 10.222.0.59 Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABiz_mX2e1XiyjAxB7icXI4AUvtfhnO5dEfNJbnRpS_nBeRcXNn77gPEIJ5lBs4-dwqO1Le6uGjdeSwtssxVqZxi37InusQZxd2n6oErVU3rS6LnrZZ-rn875bftbETfx9IUAQcvKU7VSJjfR0DxT0LeKLqCntRjRFytEbA-7ZwEGAApPU Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Role: member,reader,admin Jul 14 11:10:16.522749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Roles: member,reader,admin Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7da05e4cf2b444729a9cbe3b6d5db535", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7da05e4cf2b444729a9cbe3b6d5db535"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant-Id: 7da05e4cf2b444729a9cbe3b6d5db535 Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Id: 23fec8c4e37c41799ff49ae249e16e30 Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: method: > Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: exception: Flavor 451 could not be found. Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: action_args: {'id': '451'} Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:10:16.524309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:16.525266 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 11:10:16.526778 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-253d107c-6e11-4ba5-9b62-322c30131650 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:10:16.528004 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-253d107c-6e11-4ba5-9b62-322c30131650 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012258 Jul 14 11:10:16.528004 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jul 14 11:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:17.497291 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:17.498299 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 14 11:10:17.498694 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:18.146884 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-9c8889f9-e2b4-4fcc-a8d9-548a1e40db37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:18.215653 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-9c8889f9-e2b4-4fcc-a8d9-548a1e40db37 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.577471 Jul 14 11:10:18.216206 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jul 14 11:10:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:10:19.185835 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:19.186898 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 14 11:10:19.187346 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:19.714601 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-4fd65b79-13e6-499e-81c2-c28724bab8f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:19.791953 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-4fd65b79-13e6-499e-81c2-c28724bab8f6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.462930 Jul 14 11:10:19.792490 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jul 14 11:10:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:10:20.766798 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:20.768810 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002414 Jul 14 11:10:20.769198 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:21.297815 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5d1fd774-ea0e-41b8-b8b6-42ee4b5b8ffb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:21.380673 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-5d1fd774-ea0e-41b8-b8b6-42ee4b5b8ffb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.466703 Jul 14 11:10:21.381206 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jul 14 11:10:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:10:22.358315 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:22.359353 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jul 14 11:10:22.359745 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:22.884308 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-0aee24ee-5ec2-4d8b-8475-4be58daf3a6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:10:22.949033 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-0aee24ee-5ec2-4d8b-8475-4be58daf3a6b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.448000 Jul 14 11:10:22.949662 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Thu Jul 14 11:10:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:10:23.925620 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:23.926607 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 14 11:10:23.926996 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:10:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:10:24.451647 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-679c7969-eb91-46b3-b9bb-2310dbbc5178 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:10:24.470880 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-679c7969-eb91-46b3-b9bb-2310dbbc5178 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404091 Jul 14 11:10:24.471435 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Thu Jul 14 11:10:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:17.424747 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.425748 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-004e8cc3-8930-4346-ae41-4dd6aa6c26cc admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 14 11:11:17.426167 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:11:17.436621 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:17.818358 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-fc1847b0-f81d-4dfd-b8b3-d4be9153425f admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.838102 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-fc1847b0-f81d-4dfd-b8b3-d4be9153425f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406153 Jul 14 11:11:17.838633 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:11:17.860080 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:17.864023 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-2f8e7a1c-8828-4507-8763-7d9ae9a7afbc admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.871443 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-2f8e7a1c-8828-4507-8763-7d9ae9a7afbc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013051 Jul 14 11:11:17.872473 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:17.884255 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-56b79580-d31e-4fbe-8fd7-db6507746d1f admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.892504 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-56b79580-d31e-4fbe-8fd7-db6507746d1f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011884 Jul 14 11:11:17.893020 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:17.904723 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.912725 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011772 Jul 14 11:11:17.913243 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:11:17.924587 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-710543f0-9bcb-4f8b-a40a-74cff307dd98 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:11:17.932283 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-710543f0-9bcb-4f8b-a40a-74cff307dd98 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011329 Jul 14 11:11:17.932788 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Thu Jul 14 11:11:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:14:51.878833 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:51.880119 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Jul 14 11:14:51.880589 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:14:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:14:52.028130 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=6 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:14:52.226556 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-38a6d833-1a45-4b0f-af90-ea08010f819b admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:52.227781 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:14:52.227781 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 11:14:52.229044 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-38a6d833-1a45-4b0f-af90-ea08010f819b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:52.229484 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-38a6d833-1a45-4b0f-af90-ea08010f819b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:52.230275 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-38a6d833-1a45-4b0f-af90-ea08010f819b admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:52.230723 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-38a6d833-1a45-4b0f-af90-ea08010f819b admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:52.274245 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-38a6d833-1a45-4b0f-af90-ea08010f819b admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.247835 Jul 14 11:14:52.274827 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jul 14 11:14:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:14:53.179865 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:53.180728 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 14 11:14:53.181135 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:14:53.415524 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-88da95fa-2c51-4cc1-b72f-04c1f0f97f12 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:14:53.416712 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:14:53.416712 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 11:14:53.418045 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-88da95fa-2c51-4cc1-b72f-04c1f0f97f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:53.418453 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-88da95fa-2c51-4cc1-b72f-04c1f0f97f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:53.419326 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-88da95fa-2c51-4cc1-b72f-04c1f0f97f12 admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:14:53.419772 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-88da95fa-2c51-4cc1-b72f-04c1f0f97f12 admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:14:53.486811 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-88da95fa-2c51-4cc1-b72f-04c1f0f97f12 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.142930 Jul 14 11:14:53.487661 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jul 14 11:14:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:15:04.765953 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:04.767054 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 14 11:15:04.767481 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:15:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:15:04.912538 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:04.913257 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell1:SELECT=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:04.913872 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=8 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:04.963114 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-fa0c6a92-cb8c-4686-9030-36128a236240 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:04.964309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:15:04.964309 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 11:15:04.965498 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-fa0c6a92-cb8c-4686-9030-36128a236240 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:04.965969 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-fa0c6a92-cb8c-4686-9030-36128a236240 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:04.967462 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-fa0c6a92-cb8c-4686-9030-36128a236240 admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:04.967894 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-fa0c6a92-cb8c-4686-9030-36128a236240 admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:04.994084 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-fa0c6a92-cb8c-4686-9030-36128a236240 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085917 Jul 14 11:15:04.994649 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jul 14 11:15:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:15:05.823707 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:05.824708 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4055b40f-1177-4599-a592-d43485883d30 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 14 11:15:05.825101 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Thu Jul 14 11:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:15:06.017371 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-92a05d5c-f657-476a-a7c2-d96d8a9b7a38 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:15:06.018525 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:15:06.018525 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 11:15:06.019749 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-92a05d5c-f657-476a-a7c2-d96d8a9b7a38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:06.020226 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-92a05d5c-f657-476a-a7c2-d96d8a9b7a38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:06.021111 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-92a05d5c-f657-476a-a7c2-d96d8a9b7a38 admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:15:06.021546 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-92a05d5c-f657-476a-a7c2-d96d8a9b7a38 admin admin] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:15:06.043519 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-92a05d5c-f657-476a-a7c2-d96d8a9b7a38 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078653 Jul 14 11:15:06.044148 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Thu Jul 14 11:15:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:16:07.128771 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: Thu Jul 14 11:16:07 2022 - graceful shutdown triggered... Jul 14 11:16:07.128489 dv-cinder-822821-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 11:16:07.129739 dv-cinder-822821-5-iscsi devstack@n-api.service[103721]: Gracefully killing worker 1 (pid: 103721)... Jul 14 11:16:07.130116 dv-cinder-822821-5-iscsi devstack@n-api.service[103722]: Gracefully killing worker 2 (pid: 103722)... Jul 14 11:16:08.129520 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: worker 1 buried after 1 seconds Jul 14 11:16:08.130047 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: worker 2 buried after 1 seconds Jul 14 11:16:08.130047 dv-cinder-822821-5-iscsi devstack@n-api.service[103720]: goodbye to uWSGI. Jul 14 11:16:08.131158 dv-cinder-822821-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 11:16:08.131707 dv-cinder-822821-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 11:16:08.134463 dv-cinder-822821-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 11:16:08.146388 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:16:08 2022] *** Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: nodename: dv-cinder-822821-5-iscsi Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: machine: x86_64 Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: clock source: unix Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: pcre jit disabled Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: detected number of CPU cores: 4 Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: current working directory: / Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: your processes number limit is 47680 Jul 14 11:16:08.148520 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: your memory page size is 4096 bytes Jul 14 11:16:08.149408 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: detected max file descriptor number: 2048 Jul 14 11:16:08.149408 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: lock engine: pthread robust mutexes Jul 14 11:16:08.149408 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: thunder lock: enabled Jul 14 11:16:08.149408 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 11:16:08.149408 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:16:08.196486 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: Python main interpreter initialized at 0x55939ebe99c0 Jul 14 11:16:08.196486 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: python threads support enabled Jul 14 11:16:08.196486 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: your server socket listen backlog is limited to 100 connections Jul 14 11:16:08.196486 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:16:08.196891 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:16:08.196959 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: *** Operational MODE: preforking *** Jul 14 11:16:08.197250 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:16:08.197250 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: spawned uWSGI master process (pid: 118226) Jul 14 11:16:08.197460 dv-cinder-822821-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 11:16:08.198170 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: spawned uWSGI worker 1 (pid: 118244, cores: 1) Jul 14 11:16:08.199396 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: spawned uWSGI worker 2 (pid: 118245, cores: 1) Jul 14 11:16:08.200058 dv-cinder-822821-5-iscsi devstack@n-api.service[118226]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:16:08.873271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:16:08.873859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 11:16:10.101695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:16:10.101695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: from cryptography.utils import int_from_bytes Jul 14 11:16:10.102453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:16:10.102453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: from cryptography.utils import int_from_bytes Jul 14 11:16:10.124445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:16:10.124445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: from cryptography.utils import int_from_bytes Jul 14 11:16:10.124995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:16:10.124995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: from cryptography.utils import int_from_bytes Jul 14 11:16:12.461822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:16:12.462329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:16:12.462541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:16:12.462910 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:16:12.463245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:16:12.463592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.464483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.464814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.465144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.465481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.465797 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.466123 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.466447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.466782 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.467059 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.467393 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.467726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-5-iscsi {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.468054 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.468369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.468684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.469009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.469318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.469646 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.469973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.470462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.471880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.472444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.473001 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.473582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.474137 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.474868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.475553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.476212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.476776 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.477586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.479414 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-5-iscsi {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.480620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.481329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.481880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.482000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:16:12.482433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:16:12.482801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:16:12.483132 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.483241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:16:12.483451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:16:12.483559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.483811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.483922 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.484162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.484270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.484487 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.484598 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.484817 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.484993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.485152 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.485447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.485553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.485785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.485898 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.486109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.486409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.486514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.486697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.486799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.487019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.487212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.487374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822821-5-iscsi {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.487472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.487708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.487875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488195 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.488965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.489062 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.489284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.489399 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.489597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.489708 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.490025 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.490118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.490372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.490547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.490709 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.490861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491365 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491516 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.491978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.492129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.492291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.492453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.492610 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.492760 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.492913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.493063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.493206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.493357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.493600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822821-5-iscsi {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.493771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.493915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.494064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.494219 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.494371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.494534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.494684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.494934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.495281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.495451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.495597 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.495770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.495927 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.496106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.496388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.496547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.496746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.496901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.497056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.497208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.497365 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.497514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.497720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.497871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498520 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.498968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.499149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.499317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.499468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.499621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.499775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.499928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500526 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.500985 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.501135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.501288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.501442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.501588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.501747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.501901 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502498 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.502971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.503160 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.503310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.503463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.503648 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.503920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.504070 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.504220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.504363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.504513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.504666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.504828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505006 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505492 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505790 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.505931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.506079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.506221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.506395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.506558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.506711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.506872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.507981 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.508131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.508282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.508433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.508576 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.508732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.508890 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509640 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.509972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.510138 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.510293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.510437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.510634 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.510869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.511018 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.511203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.511494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.511730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.511882 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512177 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512324 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.512950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.513112 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.513262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.513412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.513566 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.513717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514180 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514647 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514799 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.514950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.515100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.515100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.515550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.515710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.515855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516003 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516147 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.516891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517650 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517804 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.517960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.518103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.518252 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.518401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.518551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.518703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.518847 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.519006 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.519219 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.519391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.519544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.519699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.519843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.519992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.520139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.520291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.520447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.520597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.520746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.520889 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.521038 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.521200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.521353 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.521502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.521702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.521859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.522034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.522183 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.522406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.522561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.522713 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.522854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.523006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.523171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.523345 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.523490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.523639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.523789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.523942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.524255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.524413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.524558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.524707 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.524851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.524992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.525149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.525301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.525549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.525704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.525854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.525998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.526157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.526871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.527027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:16:12.527204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.527448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.527608 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.527796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.527947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.528151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.528313 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.528469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.528621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.528811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.528980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.529139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.529302 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.529469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.529633 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.529800 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.529944 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.530094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.530247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.530427 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.530588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.530741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.530885 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.531056 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.531253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.531400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.531551 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.531707 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.531949 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.532099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.532358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.532515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.532675 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.532832 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.532986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.533130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.533316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.533466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.533626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.533771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.533948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.534097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.534403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.534574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.534735 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.534880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.535029 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.535193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.535341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.535495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.535735 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.535884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536187 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536473 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536640 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.536935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.537162 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.537330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.537487 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.537632 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.537782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.537933 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.538123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.538272 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.538428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.538579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.538797 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.539043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.539254 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.539401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.539631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.539777 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.539920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540061 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.540979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.541121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.541272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.541423 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.541573 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.541716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.541984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.542727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.542902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.543102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.543277 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.543420 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.543584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.543736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.543894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.544046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.544198 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.544512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.544675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.544820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.544973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.545119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.545261 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.545403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.545553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.545726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.545953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546104 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546845 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.546992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.547155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.547303 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.547456 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.547608 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.547772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.548042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.548364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.548512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.548672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.548874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.549032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.549226 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.549377 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.549610 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.549770 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.549927 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.550078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.550250 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.550403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.550546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.550716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.550864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.551014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.551179 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.551337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.551479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.551637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.551780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.552049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.552210 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.552361 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.552511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.552731 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.552896 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.553047 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.553190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.553358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.553522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.553703 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.553859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.554035 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.554188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.554349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.554523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.554838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.554992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.555244 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.555396 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.555396 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.555679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.555824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.556069 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.556234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.556234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.556537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.556712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.556877 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.557033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.557183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.557339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.558100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.558322 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.558571 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.558835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.559100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.559371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.559645 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.559645 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.560067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.560221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.560221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.560775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.560943 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.561103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.561267 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.561418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.561575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.561736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.562131 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.562293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.562293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.562293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.562726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.562875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563035 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563666 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.563985 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.564136 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.564284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.564459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.564610 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.564977 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.565147 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.565299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.565456 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.565607 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.565761 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.565924 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.566093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.566338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.566501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.566661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.566831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.566992 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.567233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.567392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.567553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.567704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.567867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.567867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.568155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.568310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.568468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.568625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.568789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.568954 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.569109 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.569260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.569416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.569573 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.569733 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.569883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.570833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.571162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.571320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.571469 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.571634 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.571792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.571953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.572110 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.572266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.572501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.572655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.572804 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.572970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.573274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.573921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.573921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.574235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.574393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.574550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.574708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.574886 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.575255 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.575424 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.575581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.575742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.575904 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.576060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.576219 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.576469 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.576626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.576626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.576926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.577098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.577251 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.577406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.577557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.577713 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.577863 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578185 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578340 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.578940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.579090 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.579268 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.579419 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.579568 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.579717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.579878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580510 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.580980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.581129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.581284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.581433 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.581600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.581759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.581924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.582097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.582247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.582395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.582557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.582557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.582857 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.583014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.583228 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.583384 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.583547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.583782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584005 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584352 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.584993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.585160 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.585479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.585650 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.585802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.585952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.585952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.586242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.586403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.586655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.586811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.586962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.587110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.587299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.587456 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.587615 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.587764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.587913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.588070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.588220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.588375 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.588549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.589345 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.589512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.589672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.589822 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.589985 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.590320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.590500 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.590672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.590831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.590989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.591209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.591367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.591540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.591699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.591699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.591998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.592162 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.592322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.592472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.592628 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.592788 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.592948 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.593099 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.593249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.593417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.593567 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.593717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.593878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594029 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594812 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.594963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.595136 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.595307 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.595638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.595796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.595956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.596131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.596283 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.596441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.596593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.596835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.596835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.597181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.597342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.597502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.597652 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.597821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.597981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.598138 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.598288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.598445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.598596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.598751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.598913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.599064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.599249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.599401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.599560 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.599721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.599884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600486 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.600951 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.601101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.601258 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.601417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.601577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.601737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.601893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.602043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.602043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.602327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.602490 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.602655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.603060 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.603249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.603400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.603560 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.603727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.603887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.604049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.604198 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.604469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.604821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.604990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.605150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.605308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.605466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.605783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.605964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.606118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.606269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.606430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.606581 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.606738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.606738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.607172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.607270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.607432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.607757 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.608081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.608403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.608560 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.608718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.608877 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609196 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.609977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.610142 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.610298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.610448 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.611111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.611321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.611478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.611653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.611813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.611964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.612122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.612280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.612437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.612597 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.612748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.612904 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.613054 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.613217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.613382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.613611 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.613785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.613944 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.614094 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.614244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.614403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.614554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.614703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.614852 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.615000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.615185 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.615358 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.615509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.615668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.615998 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.616163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.616316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.616480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.616637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.616637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.616937 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.617184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.617340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.617501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.617652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.617801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.617950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.618117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.618278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.618437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.618588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.618745 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.618745 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.619045 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.619286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.619449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.619609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.619772 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.619978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.620996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.621291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.621443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.621602 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.621752 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.621752 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622220 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.622994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.623164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.623330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.623492 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.623643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.623853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624024 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624354 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624827 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.624993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.625151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.625301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.625450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.625599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.625759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.625927 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.626231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.626389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.626389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.626693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.626693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.626990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.627175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.627414 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.627577 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.627737 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.627897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.628049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.628198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.628355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.628512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.628681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.628846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629622 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.629938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.630089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.630239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.630389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.630562 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.630722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.630879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.631030 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.631220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.631388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.631548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.631699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.631855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632475 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632795 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.632943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.633102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.633253 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.633422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.633581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.633739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.633890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634039 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.634997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.635187 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.635346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.635495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.635691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.635844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.635993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.636317 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.636483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.636642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.636794 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.636955 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.637127 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.637281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.637522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.637679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.637829 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.637987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.638149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.638300 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.638458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.638609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.638767 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.638930 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.639089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.639309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.639471 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.639630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.639781 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.639978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.640148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.640422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.640579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.640729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.640878 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.641038 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.641208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.641366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.641524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.641673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.641822 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.642989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.643160 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.643337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.643545 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.643710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.643924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.644166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.644319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.644475 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.644634 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.644791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.644956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.645115 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.645273 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.645446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.645605 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.645756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.645922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.646073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.646248 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.646548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.646708 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.646859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.647019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.647243 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.647555 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.647727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.647900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.648984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.649136 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.649362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.649529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.649723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.649879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.650054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.650286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.650454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.650614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.650764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.650928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.651079 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.651839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.652001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.652163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.652383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.652551 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.652714 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.652873 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653808 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.653957 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.654107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.654281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.654435 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.654585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.654752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.654912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.655064 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.655255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.655409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.655559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.655709 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.655866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.656030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.656189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.656340 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.656642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.656798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.656961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.657151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.658220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.658383 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.658546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.658706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.658856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.659014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.659209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.659388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.659550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.659701 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.659865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660025 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.660944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.661094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.661253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.661419 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.661578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.661736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.661897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.662055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.662214 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.662372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.662532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.662690 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.662866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663817 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.663986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.664151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.664320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.664471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.664629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.664780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.664940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.665092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.665092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.665384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.665533 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.665691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.665866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.666055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.666218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.666371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.666522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.666980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.667219 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.667460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.667620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.667772 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.667930 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.668090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.668433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.668433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.668750 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.668902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669375 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669654 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.669951 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670412 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670588 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670736 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.670859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.671056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.671461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.671590 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.671900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.672004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.672245 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.672341 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.672591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.672691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.672932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.673034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.673254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.673391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.673592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.673684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.673908 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674556 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.674978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.675218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.675328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.675537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.675639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.675857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.675957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.676174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.676264 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.676494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.676584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.676821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.676956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.677133 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.677234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.677449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.677709 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.677997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.678089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.678361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.678466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.678839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.679050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.679232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.679422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.679700 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.679798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.680048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.680145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.680364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.680462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.680687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.680778 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681799 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.681967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.682120 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.682296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.682959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.683167 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.683314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.683486 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.683704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.683902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.684050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.684227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.684391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.684539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.684692 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.684902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.685049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.685226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.685375 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.685527 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.685845 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.685992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.686165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.686314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.686489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.686643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.686809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.686982 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.687207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.687316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.687470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.687571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.687791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.688015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.688106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.688349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.688450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.688677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.688767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.689002 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.689101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.689326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.689427 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.689684 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.689775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690768 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.690987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.691078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.691339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.691544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.691666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.691867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.691993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.692211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.692434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.692610 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.692762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.692947 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.693117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.693288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.693442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.693625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.693719 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.693951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.694050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.694240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.694409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.694568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.694868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.695070 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.695299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.695518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.695656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.695785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.695923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.696183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.696286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.696462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.696621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.696771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.696928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.697099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.697256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.697405 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.697796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.697964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.698753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.698961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.699174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.699174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.699479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.699626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.699798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.699977 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.700126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.700220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.700336 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.700503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.700774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.700983 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.701088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.701176 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.701434 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.701606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.701757 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.701861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.702125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.702237 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.702391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.702515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.702711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.702821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.703031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.703166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.703371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.703509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.703691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.703859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.704084 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.704195 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.704343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.704584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.704700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.704869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.705942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.706153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.706242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.706467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.706696 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.706788 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.707056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.707179 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.707410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.707515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.707753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.707858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.708072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.708311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.708413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.708651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.708750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.708972 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.709085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.709311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.709401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.709632 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.709724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.709945 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.710041 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.710258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.710348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.710580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.710670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.710898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.711048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.711232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.711328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.711557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.711656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.711918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.712019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.712185 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.712289 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.712507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.712597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.712826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.713077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.713176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.713420 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.713512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.713788 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.713890 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.714101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.714248 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.714424 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.714746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.714835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.715063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.715179 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.715404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.715503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.715722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.715811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.716994 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.717091 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.717312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.717403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.717624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.717712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.717941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.718029 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.718271 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.718591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.718707 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.718909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.719040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.719250 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.719384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.719570 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.719703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.719888 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.720030 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.720208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.720389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.720531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.720840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.720976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.721191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.721323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.721416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.721507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.721739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.722440 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.722581 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.722705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.722705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.723904 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724252 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.724889 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.725046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.725222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.725368 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.725544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.726712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.726882 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727024 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727145 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727317 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727399 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727584 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.727674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728186 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728186 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.728993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.729348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.729540 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.729677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.730046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.730161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.730458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.730564 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.730731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.730833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.731053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.731183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.731410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.731565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.731734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.731828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.732060 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.732150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.732382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.732619 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.732727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.732813 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733122 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.733959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.734055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.734275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.734380 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.734588 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.734687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.734904 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.735093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.735335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.735436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.735550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.735754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.735900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.736088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.736197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.736409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.736501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.736743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.736840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737790 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.737998 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.738111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.738326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.738434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.738625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.738733 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.738938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.739040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.739303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.739427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.739746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.739943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.740048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.740274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.740373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.740671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.740863 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.740998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.741193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.741319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.741601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.741712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.741845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.741998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.742177 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.742273 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.742511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.742617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.742864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743271 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743412 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743559 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743701 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743841 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.743994 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.744140 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.744287 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.744424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.744562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.744739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.744889 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.745667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.745814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.746052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.746263 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.746413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.746609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.747196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.747354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.747556 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.747656 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.747887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.747980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.748217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.748316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.748568 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.748704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.748877 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.748979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.749204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.749303 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.749531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.749622 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.749887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.750199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.750523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.750841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.750944 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.751190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.751343 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.751516 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.751608 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.751848 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.751956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.752224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.752318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.752485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.752631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.752821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.753024 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.753121 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.753354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.753458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.753705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.753785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.754032 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.754137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.754361 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.754449 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.754691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.754782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.755024 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.755106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.755374 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.755469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.755702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.755782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.756100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.756195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.756385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.756473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.756711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.756801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.757025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.757113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.757278 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:16:12.757366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.757686 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.758019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.758345 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.758763 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.759109 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.759414 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.759792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.760118 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.760495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.760934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.761264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.761593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.761928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.762329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.762768 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.763187 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.763522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.764030 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.764386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.764759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.765121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.765483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.765828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.766216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.766479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.766799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:16:12.767051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:16:12.912868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO dbcounter [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Registered counter for database nova_api Jul 14 11:16:12.922182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO dbcounter [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Registered counter for database nova_api Jul 14 11:16:12.935669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_db.sqlalchemy.engines [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:12.943314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writer thread running {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:12.943805 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_db.sqlalchemy.engines [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:12.950881 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writer thread running {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.002087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.context [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35b895b2-8a39-4db8-bdc4-5ba8397f943e(cell1) {{(pid=118245) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:16:13.006460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:13.007935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:13.008742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:13.010081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.context [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35b895b2-8a39-4db8-bdc4-5ba8397f943e(cell1) {{(pid=118244) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 11:16:13.010790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:13.012992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO dbcounter [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Registered counter for database nova_cell0 Jul 14 11:16:13.014323 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:13.015971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:13.016865 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:16:13.017485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO dbcounter [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Registered counter for database nova_cell1 Jul 14 11:16:13.018893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:16:13.020937 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO dbcounter [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Registered counter for database nova_cell0 Jul 14 11:16:13.025035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_db.sqlalchemy.engines [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:13.025204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO dbcounter [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Registered counter for database nova_cell1 Jul 14 11:16:13.029355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_db.sqlalchemy.engines [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:13.036077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_db.sqlalchemy.engines [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:13.037264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_db.sqlalchemy.engines [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:13.039532 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writer thread running {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.040984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writer thread running {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.044681 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writer thread running {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.046075 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writer thread running {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.191687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO dbcounter [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Registered counter for database nova_cell0 Jul 14 11:16:13.194641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO dbcounter [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Registered counter for database nova_cell0 Jul 14 11:16:13.199797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_db.sqlalchemy.engines [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:13.201379 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_db.sqlalchemy.engines [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:16:13.204639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writer thread running {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.205816 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writer thread running {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:16:13.527722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: WARNING keystonemiddleware.auth_token [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:16:13.531964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: WARNING keystonemiddleware.auth_token [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:16:13.536015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: WARNING keystonemiddleware.auth_token [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:16:13.539310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: WARNING keystonemiddleware.auth_token [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:16:13.880808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: WARNING keystonemiddleware.auth_token [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:16:13.884702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: WARNING keystonemiddleware.auth_token [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 11:16:13.887502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: WARNING keystonemiddleware.auth_token [None req-846ef934-4949-44da-83d4-d0be5a1fa773 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:16:13.891489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: WARNING keystonemiddleware.auth_token [None req-568d2e95-49b7-46cc-a41d-de7aa4e26ba1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 11:16:13.893751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55939ebe99c0 pid: 118245 (default app) Jul 14 11:16:13.897777 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55939ebe99c0 pid: 118244 (default app) Jul 14 11:16:57.560702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.561546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.562493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.563286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.672818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.680392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.680392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:57.680392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:59.030558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-275b5dfb-05a6-45f1-a369-df20c2cfc945 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Action: 'create', calling method: .version_select at 0x7f3414361c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-405376972", "metadata": {"Type": "work"}}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-275b5dfb-05a6-45f1-a369-df20c2cfc945 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Request method failure captured: Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 121 Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spDe76BwEe4A2TabJw1wVg11J_UJqMnAZAi4UJFpdmaSFAgpedckkNV04Igdk0Xs_0Gh_mHgll31gy-fLPARE7nwzNr3-yjlV_LZNQyDN0cTT4YFX0iEBG66Q-aXYjjg9qWsYImt3lFzvvhewdeJViD_CN26ntkL_mfgsVW2xhVSM Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:16:59.083107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_debc507273144e218f7c398e615bef01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/debc507273144e218f7c398e615bef01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3e22a5abdc2547d5acb7c5034f6983a9 Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-405376972", "metadata": {"Type": "work"}}} Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:16:59.085523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-405376972', 'metadata': {'Type': 'work'}}}} Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:16:59.086319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:16:59.087668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:16:59.088746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 11:16:59.088746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.088746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-275b5dfb-05a6-45f1-a369-df20c2cfc945 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:16:59.088746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-275b5dfb-05a6-45f1-a369-df20c2cfc945 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.523689 Jul 14 11:16:59.088746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jul 14 11:16:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1526 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:16:59.089076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-912f74f1-340b-4ffb-9722-600238a60983 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Action: 'create', calling method: .version_select at 0x7f3414362ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-48742987"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:59.091567 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6cac71a3-81c6-43eb-be6e-9fb461a84ce1 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Action: 'create', calling method: .version_select at 0x7f3414379ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-773146975", "metadata": {"Type": "work"}}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6cac71a3-81c6-43eb-be6e-9fb461a84ce1 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Request method failure captured: Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 119 Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spDe76BwEe4A2TabJw1wVg11J_UJqMnAZAi4UJFpdmaSFAgpedckkNV04Igdk0Xs_0Gh_mHgll31gy-fLPARE7nwzNr3-yjlV_LZNQyDN0cTT4YFX0iEBG66Q-aXYjjg9qWsYImt3lFzvvhewdeJViD_CN26ntkL_mfgsVW2xhVSM Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:16:59.094612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_debc507273144e218f7c398e615bef01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/debc507273144e218f7c398e615bef01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3e22a5abdc2547d5acb7c5034f6983a9 Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-773146975", "metadata": {"Type": "work"}}} Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:16:59.106783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-773146975', 'metadata': {'Type': 'work'}}}} Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi '0' Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:16:59.110430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:16:59.120642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6cac71a3-81c6-43eb-be6e-9fb461a84ce1 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6cac71a3-81c6-43eb-be6e-9fb461a84ce1 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010434 Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 2/2] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jul 14 11:16:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-65289ea2-cbc5-469f-a537-77bbb4107cd4 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Action: 'create', calling method: .version_select at 0x7f34143790d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-135175198", "metadata": {"Type": "work"}}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-65289ea2-cbc5-469f-a537-77bbb4107cd4 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Request method failure captured: Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 11:16:59.121778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 118 Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spDe76BwEe4A2TabJw1wVg11J_UJqMnAZAi4UJFpdmaSFAgpedckkNV04Igdk0Xs_0Gh_mHgll31gy-fLPARE7nwzNr3-yjlV_LZNQyDN0cTT4YFX0iEBG66Q-aXYjjg9qWsYImt3lFzvvhewdeJViD_CN26ntkL_mfgsVW2xhVSM Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:16:59.122347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_debc507273144e218f7c398e615bef01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/debc507273144e218f7c398e615bef01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3e22a5abdc2547d5acb7c5034f6983a9 Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-135175198", "metadata": {"Type": "work"}}} Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-135175198', 'metadata': {'Type': 'work'}}}} Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise error Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi '' Jul 14 11:16:59.124031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.126467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-65289ea2-cbc5-469f-a537-77bbb4107cd4 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:16:59.131221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-65289ea2-cbc5-469f-a537-77bbb4107cd4 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023752 Jul 14 11:16:59.137475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 3/3] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jul 14 11:16:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:16:59.165601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c65eedf3-7fac-4e29-bc1a-97e61c9c22c8 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Calling method '.version_select at 0x7f3414291b80>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:16:59.967505 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-c65eedf3-7fac-4e29-bc1a-97e61c9c22c8 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] HTTP exception thrown: Volume tempest-invalid-386353290 could not be found. Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c65eedf3-7fac-4e29-bc1a-97e61c9c22c8 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Request method failure captured: Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-386353290 HTTP/1.1 Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spDe76BwEe4A2TabJw1wVg11J_UJqMnAZAi4UJFpdmaSFAgpedckkNV04Igdk0Xs_0Gh_mHgll31gy-fLPARE7nwzNr3-yjlV_LZNQyDN0cTT4YFX0iEBG66Q-aXYjjg9qWsYImt3lFzvvhewdeJViD_CN26ntkL_mfgsVW2xhVSM Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:16:59.973256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_debc507273144e218f7c398e615bef01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/debc507273144e218f7c398e615bef01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: debc507273144e218f7c398e615bef01 Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3e22a5abdc2547d5acb7c5034f6983a9 Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-668521202-project Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume tempest-invalid-386353290 could not be found. Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'tempest-invalid-386353290'} Jul 14 11:16:59.975072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-386353290 could not be found. (HTTP 404) (Request-ID: req-bbc13453-ce2b-4b0a-b2e3-04cd10004920) Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:16:59.976078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:17:00.051986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-386353290 could not be found. Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:00.088515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-386353290 could not be found. Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-386353290 could not be found. Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c65eedf3-7fac-4e29-bc1a-97e61c9c22c8 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Returning 404 to user: Volume tempest-invalid-386353290 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c65eedf3-7fac-4e29-bc1a-97e61c9c22c8 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-386353290" status: 404 len: 98 microversion: 2.1 time: 0.827112 Jul 14 11:17:00.091155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 4/4] 10.222.0.59 () {58 vars in 1214 bytes} [Thu Jul 14 11:16:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-386353290 => generated 98 bytes in 842 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:17:00.092537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4d8e8317-3b0e-455f-add3-0cf630d5eb26 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010287 Jul 14 11:17:00.092537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 5/5] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Jul 14 11:16:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 11:17:00.092537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1c3a1d29-c97d-4d1f-bda4-3ad14cf5f793 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006970 Jul 14 11:17:00.092537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 6/6] 10.222.0.59 () {58 vars in 1136 bytes} [Thu Jul 14 11:16:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 14 11:17:00.092537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-832189aa-e980-46aa-8d62-31bdda5326fd tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Calling method '.version_select at 0x7f34141aef70>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:00.581433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-832189aa-e980-46aa-8d62-31bdda5326fd tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] HTTP exception thrown: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-832189aa-e980-46aa-8d62-31bdda5326fd tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Request method failure captured: Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/os-volumes/0bd44ef6-71e6-4728-865d-3bcd51c29d90 HTTP/1.1 Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spDe76BwEe4A2TabJw1wVg11J_UJqMnAZAi4UJFpdmaSFAgpedckkNV04Igdk0Xs_0Gh_mHgll31gy-fLPARE7nwzNr3-yjlV_LZNQyDN0cTT4YFX0iEBG66Q-aXYjjg9qWsYImt3lFzvvhewdeJViD_CN26ntkL_mfgsVW2xhVSM Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: debc507273144e218f7c398e615bef01 Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:17:00.582155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_debc507273144e218f7c398e615bef01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/debc507273144e218f7c398e615bef01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-668521202 Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: debc507273144e218f7c398e615bef01 Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-668521202-project Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3e22a5abdc2547d5acb7c5034f6983a9 Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-668521202-project Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '0bd44ef6-71e6-4728-865d-3bcd51c29d90'} Jul 14 11:17:00.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. (HTTP 404) (Request-ID: req-c6e1312c-c98b-44ad-ba59-3eafa03c9083) Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:00.585232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:17:00.587077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:17:00.590522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-832189aa-e980-46aa-8d62-31bdda5326fd tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Returning 404 to user: Volume 0bd44ef6-71e6-4728-865d-3bcd51c29d90 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-832189aa-e980-46aa-8d62-31bdda5326fd tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/0bd44ef6-71e6-4728-865d-3bcd51c29d90" status: 404 len: 109 microversion: 2.1 time: 0.564370 Jul 14 11:17:00.592077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 7/7] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:17:00 2022] DELETE /compute/v2.1/os-volumes/0bd44ef6-71e6-4728-865d-3bcd51c29d90 => generated 109 bytes in 570 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:17:00.595043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-159c9553-ba74-4ea5-baad-68a88c93ab94 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Calling method '.version_select at 0x7f34141c7310>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:01.669700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-159c9553-ba74-4ea5-baad-68a88c93ab94 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] HTTP exception thrown: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-159c9553-ba74-4ea5-baad-68a88c93ab94 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Request method failure captured: Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/os-volumes/91a707ba-d83f-4fbf-ad39-a53327eb51e8 HTTP/1.1 Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spDe76BwEe4A2TabJw1wVg11J_UJqMnAZAi4UJFpdmaSFAgpedckkNV04Igdk0Xs_0Gh_mHgll31gy-fLPARE7nwzNr3-yjlV_LZNQyDN0cTT4YFX0iEBG66Q-aXYjjg9qWsYImt3lFzvvhewdeJViD_CN26ntkL_mfgsVW2xhVSM Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: debc507273144e218f7c398e615bef01 Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:17:01.672402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_debc507273144e218f7c398e615bef01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/debc507273144e218f7c398e615bef01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/debc507273144e218f7c398e615bef01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-668521202 Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: debc507273144e218f7c398e615bef01 Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-668521202 Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-668521202-project Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3e22a5abdc2547d5acb7c5034f6983a9 Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-668521202-project Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '91a707ba-d83f-4fbf-ad39-a53327eb51e8'} Jul 14 11:17:01.673790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. (HTTP 404) (Request-ID: req-2802bc89-7206-4b3a-810c-70b0b23b11d5) Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:01.674539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:01.675825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:17:01.676866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. Jul 14 11:17:01.678450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:01.682197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-159c9553-ba74-4ea5-baad-68a88c93ab94 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] Returning 404 to user: Volume 91a707ba-d83f-4fbf-ad39-a53327eb51e8 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:01.682197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-159c9553-ba74-4ea5-baad-68a88c93ab94 tempest-VolumesNegativeTest-668521202 tempest-VolumesNegativeTest-668521202-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/91a707ba-d83f-4fbf-ad39-a53327eb51e8" status: 404 len: 109 microversion: 2.1 time: 1.091505 Jul 14 11:17:01.694548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 8/8] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:00 2022] GET /compute/v2.1/os-volumes/91a707ba-d83f-4fbf-ad39-a53327eb51e8 => generated 109 bytes in 1102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:17:01.878655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-912f74f1-340b-4ffb-9722-600238a60983 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.216288 Jul 14 11:17:01.880449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 1/9] 10.222.0.59 () {60 vars in 1154 bytes} [Thu Jul 14 11:16:57 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4220 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 11:17:01.894917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-25447866-7638-439c-a495-348abc1606aa tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34141ae9d0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:02.018208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-25447866-7638-439c-a495-348abc1606aa tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 200 len: 343 microversion: 2.1 time: 0.128663 Jul 14 11:17:02.019206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 9/10] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:01 2022] GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 343 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:03.035644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-63038631-89a0-4150-ba63-f9f2018e3e3f tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f3414231a60>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:03.220989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-94cb82ba-8a6b-4a41-8796-612881f2d347 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f34141c70d0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:03.528111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-63038631-89a0-4150-ba63-f9f2018e3e3f tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 200 len: 344 microversion: 2.1 time: 0.496331 Jul 14 11:17:03.537659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 2/11] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:03 2022] GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 344 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:03.543760 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-614aa221-37cd-4aa0-8d3c-bc9dfa5101db tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Action: 'create', calling method: .version_select at 0x7f34142420d0>, body: {"snapshot": {"volume_id": "1f286dd1-ede1-45ee-8713-7c92baf507fc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1357877150"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:03.566080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-94cb82ba-8a6b-4a41-8796-612881f2d347 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/fe04aec9-e456-49b4-b051-678063bb46e9" status: 200 len: 350 microversion: 2.1 time: 0.349854 Jul 14 11:17:03.573228 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 10/12] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:03 2022] GET /compute/v2.1/os-volumes/fe04aec9-e456-49b4-b051-678063bb46e9 => generated 350 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:04.498542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-614aa221-37cd-4aa0-8d3c-bc9dfa5101db tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.949572 Jul 14 11:17:04.498542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 3/13] 10.222.0.59 () {60 vars in 1161 bytes} [Thu Jul 14 11:17:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:04.509114 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-86b00b29-38a4-4db2-acd8-e7d57af88986 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f3414158160>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:04.862845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-86b00b29-38a4-4db2-acd8-e7d57af88986 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.358871 Jul 14 11:17:04.863442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 11/14] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:04 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:04.874062 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-51991894-ec69-4fd3-9244-4491395844e1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f3414231af0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:05.025165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-51991894-ec69-4fd3-9244-4491395844e1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.154967 Jul 14 11:17:05.026297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 4/15] 10.222.0.59 () {58 vars in 1139 bytes} [Thu Jul 14 11:17:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:05.042511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a2976e64-9c1d-45fb-842d-f6660429c25e tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34141588b0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:05.100395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a2976e64-9c1d-45fb-842d-f6660429c25e tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.063701 Jul 14 11:17:05.100602 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 12/16] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:05 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:06.123020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ffadbbf1-7ce5-4c3f-b47f-7de6aff3a75f tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f341424b040>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:06.188634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ffadbbf1-7ce5-4c3f-b47f-7de6aff3a75f tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.070930 Jul 14 11:17:06.190159 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 5/17] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:06 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:07.205262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f45f872d-e8c8-4866-b91e-094238048fce tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f341424b790>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:07.257270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f45f872d-e8c8-4866-b91e-094238048fce tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.057202 Jul 14 11:17:07.257899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 6/18] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:07 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:07.555232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1608549968", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "networks": [{"uuid": "3e159132-daae-4350-8ece-915e5384cd75"}]}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:07.717664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] validate_networks() for [('3e159132-daae-4350-8ece-915e5384cd75', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:17:08.269822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-983975f2-f56f-4440-91b6-681a62c54c7b tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f3414242af0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:08.361638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-983975f2-f56f-4440-91b6-681a62c54c7b tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.096167 Jul 14 11:17:08.362979 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 7/19] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:08 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:09.373670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-52ce8531-913d-468d-9d7b-ad913c375e77 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34142319d0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:09.430733 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-52ce8531-913d-468d-9d7b-ad913c375e77 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.060754 Jul 14 11:17:09.431783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 8/20] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:09 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:09.769899 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:17:09.770384 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:17:09.770910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:17:09.771356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:17:09.771940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:17:09.795911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:09.797070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:09.798054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:09.798647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:09.836925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Getting quotas for project 457a247df22a45b39318dd2add051120. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:17:09.847172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Getting quotas for user 2c8ce3b0a82f47dc9ae6a4fb2abcaeaa and project 457a247df22a45b39318dd2add051120. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:17:09.903358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:17:09.906331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:17:10.199194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9c558fc4-2cc8-475c-9209-3b9ea3b772ac tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.276984 Jul 14 11:17:10.200215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 13/21] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:17:10.210887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-858832e5-1e9e-422f-a409-eb84af3d0438 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:10.211687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-858832e5-1e9e-422f-a409-eb84af3d0438 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:10.443624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bb3e93d8-6286-486a-a248-822d773228e0 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34140b6ca0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:10.531159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bb3e93d8-6286-486a-a248-822d773228e0 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.090817 Jul 14 11:17:10.531159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 14/22] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:10 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:10.670074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-858832e5-1e9e-422f-a409-eb84af3d0438 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:10.686377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-858832e5-1e9e-422f-a409-eb84af3d0438 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1215 microversion: 2.1 time: 0.479540 Jul 14 11:17:10.687564 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 9/23] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:10 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1215 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:11.552729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-08497f26-ab61-459c-b289-06e882c8ee56 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34140b6d30>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:11.704041 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-56d064f4-87c5-4d28-865b-a3fb4ea24faa tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:11.704645 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-56d064f4-87c5-4d28-865b-a3fb4ea24faa tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:11.718596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-08497f26-ab61-459c-b289-06e882c8ee56 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.181004 Jul 14 11:17:11.719710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 15/24] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:11 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:12.253618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-56d064f4-87c5-4d28-865b-a3fb4ea24faa tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:12.253618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-56d064f4-87c5-4d28-865b-a3fb4ea24faa tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1215 microversion: 2.1 time: 0.350142 Jul 14 11:17:12.253618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 10/25] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:11 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:12.732074 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c854a598-de67-47eb-ab7e-b2a1dbd5557d tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f341305a160>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:12.835888 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c854a598-de67-47eb-ab7e-b2a1dbd5557d tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 288 microversion: 2.1 time: 0.107576 Jul 14 11:17:12.836840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 16/26] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:12 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:12.849626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4b8063e8-8f42-4341-ad98-dba78fbfaf31 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f341420eb80>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:13.092436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4b8063e8-8f42-4341-ad98-dba78fbfaf31 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 202 len: 0 microversion: 2.1 time: 0.248693 Jul 14 11:17:13.097180 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 11/27] 10.222.0.59 () {58 vars in 1253 bytes} [Thu Jul 14 11:17:12 2022] DELETE /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:17:13.105485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-43483f6f-cef8-4398-a5a6-ed2e7f72cca3 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f341305a820>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:13.188623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-43483f6f-cef8-4398-a5a6-ed2e7f72cca3 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 200 len: 287 microversion: 2.1 time: 0.089685 Jul 14 11:17:13.193446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 17/28] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:13 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:13.197650 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0d55142f-81ef-4e85-81d7-94c00d121f67 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:13.200047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0d55142f-81ef-4e85-81d7-94c00d121f67 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:13.366443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0d55142f-81ef-4e85-81d7-94c00d121f67 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:13.379243 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0d55142f-81ef-4e85-81d7-94c00d121f67 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1215 microversion: 2.1 time: 0.206310 Jul 14 11:17:13.389257 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 12/29] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:13 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:13.825254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c881325e-c6f5-4754-b2cc-a7a9f404cd47 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'create', calling method: .version_select at 0x7f34140b6700>, body: {"keypair": {"name": "tempest-keypair-599727113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAZPb6xRFGqAhvtPscAQ7+Dp4kKd9qGVS7+nCMU2ZfxmXkNJdEn5MIUpph+ezYQYnJ/Egqeo+hx/X/6PepN8mAwDF/foacD1wgjJjSLtanyCzBOrCw1bw9HJJClQDWMMw=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:13.878937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-c881325e-c6f5-4754-b2cc-a7a9f404cd47 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for project f33c57605a974b44a62eebbdaba23ade. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:17:13.890995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-c881325e-c6f5-4754-b2cc-a7a9f404cd47 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for user 3ac486b2d0ac42f9ba2fed7b17418b7a and project f33c57605a974b44a62eebbdaba23ade. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:17:14.040387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c881325e-c6f5-4754-b2cc-a7a9f404cd47 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.759442 Jul 14 11:17:14.040986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 18/30] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Jul 14 11:17:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 761 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 11:17:14.045660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1ced67ef-1935-41a8-b3be-fba5dc0cbc8d tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f3413075310>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:14.063021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1973927101", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:14.109117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1ced67ef-1935-41a8-b3be-fba5dc0cbc8d tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/65a79c78-6893-471e-bcb0-2bb4c05e3b15" status: 200 len: 350 microversion: 2.1 time: 0.066839 Jul 14 11:17:14.110602 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 19/31] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:14 2022] GET /compute/v2.1/os-volumes/65a79c78-6893-471e-bcb0-2bb4c05e3b15 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:14.202275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6a1bc7ed-c757-43db-8bb6-78998bf57776 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34140b69d0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:14.239724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-6a1bc7ed-c757-43db-8bb6-78998bf57776 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] HTTP exception thrown: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6a1bc7ed-c757-43db-8bb6-78998bf57776 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Request method failure captured: Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 HTTP/1.1 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spyi29ZK_QuaAi2LN-VFhstKFU9gI92Uh73vUtEegkpG4im5n1_oPkkcx4MR9wHRosHQmuzDqHDaZbt3hF1K-QkOiLWoAtCaFriNRhIl8-X2mTpAV_eWGC9Ow_t-WMusjEeTj3OL2jOL0_ga2d6hotWW5luikb5_NYQVgOGoHH-M4 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:17:14.242153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ac8b98f65494486a1b109c0bc4b9b52", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 2c12aa6fbe0f4ff2af596fff374e423b Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'd0ef6406-a243-454e-92c9-086cd0d77ca5'} Jul 14 11:17:14.243281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. (HTTP 404) (Request-ID: req-7cc27884-842c-4a41-9163-fa67d71ff8f7) Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.243953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:14.244884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 11:17:14.245780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6a1bc7ed-c757-43db-8bb6-78998bf57776 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Returning 404 to user: Snapshot d0ef6406-a243-454e-92c9-086cd0d77ca5 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6a1bc7ed-c757-43db-8bb6-78998bf57776 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5" status: 404 len: 111 microversion: 2.1 time: 0.045617 Jul 14 11:17:14.258014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 20/32] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:17:14 2022] GET /compute/v2.1/os-snapshots/d0ef6406-a243-454e-92c9-086cd0d77ca5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:17:14.269233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6efd2180-f3d5-48b2-83c4-ae0e1e5cf592 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f3413075d30>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:14.336245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] validate_networks() for [('e30da614-ae13-4a5b-8eaf-d8446472405a', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:17:14.586191 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6efd2180-f3d5-48b2-83c4-ae0e1e5cf592 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 202 len: 0 microversion: 2.1 time: 0.334006 Jul 14 11:17:14.587638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 21/33] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:17:14 2022] DELETE /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:17:14.600728 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:14.603853 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:14.668209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:14.668672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:14.669504 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:14.669948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:14.937784 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:14.969085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2a1e448d-8731-4bf1-a796-fb87bd0240a4 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1219 microversion: 2.1 time: 0.379785 Jul 14 11:17:14.973475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 22/34] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:14 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1219 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:14.988604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-620e4464-31b1-4a3f-964b-931428b89e07 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34128015e0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:15.228729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-620e4464-31b1-4a3f-964b-931428b89e07 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 200 len: 343 microversion: 2.1 time: 0.253572 Jul 14 11:17:15.229970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 23/35] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:14 2022] GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 343 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:15.992460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:15.994201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:16.036003 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:16.039460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:16.040840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:16.046761 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:16.335865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:16.353971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-adb8b4d9-62e1-4530-b675-70cd0ca6bbea tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1267 microversion: 2.1 time: 0.367201 Jul 14 11:17:16.370218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 24/36] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:15 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1267 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:16.386227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-74e9824f-49d2-4eb3-9907-d996c988aa68 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34127bfb80>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:16.487996 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-74e9824f-49d2-4eb3-9907-d996c988aa68 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] HTTP exception thrown: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-74e9824f-49d2-4eb3-9907-d996c988aa68 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Request method failure captured: Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc HTTP/1.1 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spyi29ZK_QuaAi2LN-VFhstKFU9gI92Uh73vUtEegkpG4im5n1_oPkkcx4MR9wHRosHQmuzDqHDaZbt3hF1K-QkOiLWoAtCaFriNRhIl8-X2mTpAV_eWGC9Ow_t-WMusjEeTj3OL2jOL0_ga2d6hotWW5luikb5_NYQVgOGoHH-M4 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:17:16.490932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ac8b98f65494486a1b109c0bc4b9b52", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 2c12aa6fbe0f4ff2af596fff374e423b Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1f286dd1-ede1-45ee-8713-7c92baf507fc'} Jul 14 11:17:16.492199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. (HTTP 404) (Request-ID: req-183420c1-8a83-4dda-9055-7027e4fa321c) Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.492937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:16.494009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:17:16.494898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-74e9824f-49d2-4eb3-9907-d996c988aa68 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Returning 404 to user: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-74e9824f-49d2-4eb3-9907-d996c988aa68 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 404 len: 109 microversion: 2.1 time: 0.121094 Jul 14 11:17:16.503510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 25/37] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:16 2022] GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:17:16.517916 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-efbd1ccd-1192-41a4-afcf-4286e5486ad1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34141ae820>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:16.588769 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-efbd1ccd-1192-41a4-afcf-4286e5486ad1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] HTTP exception thrown: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-efbd1ccd-1192-41a4-afcf-4286e5486ad1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Request method failure captured: Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc HTTP/1.1 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spyi29ZK_QuaAi2LN-VFhstKFU9gI92Uh73vUtEegkpG4im5n1_oPkkcx4MR9wHRosHQmuzDqHDaZbt3hF1K-QkOiLWoAtCaFriNRhIl8-X2mTpAV_eWGC9Ow_t-WMusjEeTj3OL2jOL0_ga2d6hotWW5luikb5_NYQVgOGoHH-M4 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:17:16.590953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ac8b98f65494486a1b109c0bc4b9b52", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 2c12aa6fbe0f4ff2af596fff374e423b Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1f286dd1-ede1-45ee-8713-7c92baf507fc'} Jul 14 11:17:16.592458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. (HTTP 404) (Request-ID: req-7765a619-372d-441d-9e8f-3cb0685ffe6c) Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.593335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 11:17:16.594462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 11:17:16.595857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.596990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.600392 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-efbd1ccd-1192-41a4-afcf-4286e5486ad1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Returning 404 to user: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:16.601558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-efbd1ccd-1192-41a4-afcf-4286e5486ad1 tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 404 len: 109 microversion: 2.1 time: 0.090030 Jul 14 11:17:16.602324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 26/38] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:17:16 2022] DELETE /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:17:16.613398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-aac8e3b9-4aed-40f4-ab1b-b524d4c47fde tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Calling method '.version_select at 0x7f34127bfa60>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:16.666688 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-aac8e3b9-4aed-40f4-ab1b-b524d4c47fde tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] HTTP exception thrown: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-aac8e3b9-4aed-40f4-ab1b-b524d4c47fde tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Request method failure captured: Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc HTTP/1.1 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_spyi29ZK_QuaAi2LN-VFhstKFU9gI92Uh73vUtEegkpG4im5n1_oPkkcx4MR9wHRosHQmuzDqHDaZbt3hF1K-QkOiLWoAtCaFriNRhIl8-X2mTpAV_eWGC9Ow_t-WMusjEeTj3OL2jOL0_ga2d6hotWW5luikb5_NYQVgOGoHH-M4 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:17:16.669875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0ac8b98f65494486a1b109c0bc4b9b52", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0ac8b98f65494486a1b109c0bc4b9b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 0ac8b98f65494486a1b109c0bc4b9b52 Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-331631203 Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 2c12aa6fbe0f4ff2af596fff374e423b Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesSnapshotsTestJSON-331631203-project Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1f286dd1-ede1-45ee-8713-7c92baf507fc'} Jul 14 11:17:16.671148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. (HTTP 404) (Request-ID: req-91f2796c-918a-41c6-8967-aff244f81fab) Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.671797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:17:16.672698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:17:16.673625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. Jul 14 11:17:16.674864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:17:16.678992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-aac8e3b9-4aed-40f4-ab1b-b524d4c47fde tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] Returning 404 to user: Volume 1f286dd1-ede1-45ee-8713-7c92baf507fc could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:17:16.681359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-aac8e3b9-4aed-40f4-ab1b-b524d4c47fde tempest-VolumesSnapshotsTestJSON-331631203 tempest-VolumesSnapshotsTestJSON-331631203-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc" status: 404 len: 109 microversion: 2.1 time: 0.073351 Jul 14 11:17:16.682448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 27/39] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:16 2022] GET /compute/v2.1/os-volumes/1f286dd1-ede1-45ee-8713-7c92baf507fc => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:17:16.721860 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:17:16.726714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:17:16.727515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:17:16.728691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:17:16.729332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:17:16.760719 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:16.762374 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:16.766537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:16.768033 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:16.820635 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:17:16.831058 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for user e3e8aa5fc932453e95080fa836dfac0c and project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:17:16.851910 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:17:16.856854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:17:17.141436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5942446a-c70e-4383-a458-a0c09d6e25ed tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.697129 Jul 14 11:17:17.148787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 13/40] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:17:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:17:17.155393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ea866fc9-ed5f-410b-b382-7b181958a4f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:17.156192 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ea866fc9-ed5f-410b-b382-7b181958a4f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:17.337280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ea866fc9-ed5f-410b-b382-7b181958a4f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:17.383744 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ea866fc9-ed5f-410b-b382-7b181958a4f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1222 microversion: 2.1 time: 0.225786 Jul 14 11:17:17.384471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 28/41] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:17 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:17.387274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:17.388213 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:17.401802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:17.411667 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:17.411667 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:17.414521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:17.461451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a65f5090-896a-41c7-b73d-c1a5b604e144 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f34127bf550>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:17.643042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a65f5090-896a-41c7-b73d-c1a5b604e144 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/677136dc-53cd-4238-ae80-faeccbb67aed" status: 200 len: 351 microversion: 2.1 time: 0.179001 Jul 14 11:17:17.649945 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 29/42] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:17:17 2022] GET /compute/v2.1/os-volumes/677136dc-53cd-4238-ae80-faeccbb67aed => generated 351 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:17.657082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-084d8c40-a519-49be-b5ea-b527bc52852b tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f341275a1f0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:17.889297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-084d8c40-a519-49be-b5ea-b527bc52852b tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.236432 Jul 14 11:17:17.898815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 30/43] 10.222.0.59 () {58 vars in 1133 bytes} [Thu Jul 14 11:17:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:17.904003 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e11304a-2f98-4283-b20e-8633f06493bf tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f34127743a0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:18.254895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2e11304a-2f98-4283-b20e-8633f06493bf tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.352237 Jul 14 11:17:18.254895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 31/44] 10.222.0.59 () {58 vars in 1148 bytes} [Thu Jul 14 11:17:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:18.259590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-116658562", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:18.374824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:18.401266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-36f76e3e-b197-4239-9286-79e6e1799ec2 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1285 microversion: 2.1 time: 1.018940 Jul 14 11:17:18.401794 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] validate_networks() for [('e30da614-ae13-4a5b-8eaf-d8446472405a', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:17:18.416866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 14/45] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:17 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1285 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:18.427553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-584cc384-e95b-480e-ad1c-6ea30dcb7b8f tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f3413028160>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:18.584978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-584cc384-e95b-480e-ad1c-6ea30dcb7b8f tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.166338 Jul 14 11:17:18.586073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 15/46] 10.222.0.59 () {58 vars in 1133 bytes} [Thu Jul 14 11:17:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:18.601617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-437ec5f9-973f-46f0-a728-b2a23b0bc0a0 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f341307eaf0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:18.782186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-437ec5f9-973f-46f0-a728-b2a23b0bc0a0 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184862 Jul 14 11:17:18.783181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 16/47] 10.222.0.59 () {58 vars in 1166 bytes} [Thu Jul 14 11:17:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:18.798627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d6e01cd8-103f-4bf6-9239-e66f418fc123 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f3413045790>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:19.033719 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d6e01cd8-103f-4bf6-9239-e66f418fc123 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.239095 Jul 14 11:17:19.035275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 17/48] 10.222.0.59 () {58 vars in 1169 bytes} [Thu Jul 14 11:17:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:19.055301 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-424f9889-c35d-4c68-a46b-31f11e084c00 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f341307e8b0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:19.292675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-424f9889-c35d-4c68-a46b-31f11e084c00 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243931 Jul 14 11:17:19.293385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 18/49] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Jul 14 11:17:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:19.306154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ac583fae-8402-4abe-a982-baaf433bea0b tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f34138f78b0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:19.606413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ac583fae-8402-4abe-a982-baaf433bea0b tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.304216 Jul 14 11:17:19.614751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 19/50] 10.222.0.59 () {58 vars in 1187 bytes} [Thu Jul 14 11:17:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:19.620727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:19.621373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:19.655486 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:19.656229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:19.657529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:19.658267 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:19.817657 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:19.825677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:19.842401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7869c73a-12b8-4df3-8622-674e0f8358b6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1273 microversion: 2.1 time: 0.226388 Jul 14 11:17:19.843005 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 20/51] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:19 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:19.870549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ede5dc8e-738c-4782-b2d8-c8870c505721 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] Calling method '.version_select at 0x7f3413019b80>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:19.891033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:17:19.891492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:17:19.891976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:17:19.892453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:17:19.892971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:17:19.927736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:19.928270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:19.929193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:19.929638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:19.991182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:17:20.024281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for user e3e8aa5fc932453e95080fa836dfac0c and project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:17:20.091936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:17:20.099734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:17:20.203775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ede5dc8e-738c-4782-b2d8-c8870c505721 tempest-VolumesTestJSON-1797762937 tempest-VolumesTestJSON-1797762937-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.348249 Jul 14 11:17:20.204442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 21/52] 10.222.0.59 () {58 vars in 1154 bytes} [Thu Jul 14 11:17:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:20.406211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4ec10b90-62cf-4ecc-9a5f-3f601a2a2740 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.134034 Jul 14 11:17:20.406211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 32/53] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:17:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:17:20.406369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3573f848-76a0-478a-a236-059fddd3b29d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:20.406369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3573f848-76a0-478a-a236-059fddd3b29d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:20.861477 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:20.862348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:20.897751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:20.898270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:20.922286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:20.928815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:21.346234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3573f848-76a0-478a-a236-059fddd3b29d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:21.359338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3573f848-76a0-478a-a236-059fddd3b29d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1221 microversion: 2.1 time: 0.961795 Jul 14 11:17:21.372241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 22/54] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:20 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1221 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:21.426809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1205751990", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "008ffa51-9a9b-4b5d-b7f8-a32846704948"}], "security_groups": [{"name": "tempest-securitygroup--282359012"}], "key_name": "tempest-keypair-599727113", "user_data": "}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:21.551716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:21.572073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-11148bb5-5386-462e-98b1-7077f07f7cfb tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.715013 Jul 14 11:17:21.572668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 33/55] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:20 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:21.890294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] validate_networks() for [('008ffa51-9a9b-4b5d-b7f8-a32846704948', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:17:22.390284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:22.390905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:22.419353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:22.420040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:22.423609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:22.426393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:22.535909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:22.547371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a9dbe637-8af5-4b41-bd17-358927b70752 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1225 microversion: 2.1 time: 0.161995 Jul 14 11:17:22.551226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 34/56] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:22 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1225 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:22.595682 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:22.598367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:22.613125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:22.614284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:22.618238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:22.624012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:23.055436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:23.070824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-34b3d808-3f54-4e3c-a96a-5ed9021a4e66 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.482204 Jul 14 11:17:23.071987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 35/57] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:22 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:23.576049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:23.576049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:23.589648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:23.609209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:23.610704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:23.611287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:23.976562 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:23.992720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a76ae3f4-6a67-4b23-9e6b-ebbbc8746131 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1217 microversion: 2.1 time: 0.430492 Jul 14 11:17:23.993326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 36/58] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:23 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1217 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:24.003905 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:17:24.004563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:17:24.005241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:17:24.005756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:17:24.006249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:17:24.047162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:24.050221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:24.051255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:24.057259 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:24.105386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:24.106339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:24.113750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:24.114428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:24.115557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:24.119896 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:24.173146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for project f33c57605a974b44a62eebbdaba23ade. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:17:24.196312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for user 3ac486b2d0ac42f9ba2fed7b17418b7a and project f33c57605a974b44a62eebbdaba23ade. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:17:24.247403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:17:24.250088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:17:24.497616 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7ce9dae7-3f58-4186-9449-2ae6ae5159ef tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.074599 Jul 14 11:17:24.505125 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 23/59] 10.222.0.59 () {62 vars in 1187 bytes} [Thu Jul 14 11:17:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 3080 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 11:17:24.516932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-28e11029-e17a-458b-8602-63f24e7ad612 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:24.517573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-28e11029-e17a-458b-8602-63f24e7ad612 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:24.756322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28e11029-e17a-458b-8602-63f24e7ad612 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:24.763344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28e11029-e17a-458b-8602-63f24e7ad612 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:24.786072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28e11029-e17a-458b-8602-63f24e7ad612 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:24.798446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-28e11029-e17a-458b-8602-63f24e7ad612 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1281 microversion: 2.20 time: 0.286784 Jul 14 11:17:24.804294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 24/60] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:24 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:25.021103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:25.028224 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:25.072750 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:25.073783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:25.074826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:25.075362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:25.515089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:25.515089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ca2f8bdb-9c78-4041-9a8a-a08fd717dc84 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 1.418477 Jul 14 11:17:25.523415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 37/61] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:24 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:25.565386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:25.586953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-33047c84-8418-488a-a204-bfda23416212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1273 microversion: 2.1 time: 0.576752 Jul 14 11:17:25.588014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 25/62] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:25 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1273 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:25.829233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0e65d112-320e-401f-a55b-ed39ab9a6f6d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:25.830559 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0e65d112-320e-401f-a55b-ed39ab9a6f6d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:26.031324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e65d112-320e-401f-a55b-ed39ab9a6f6d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:26.050422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e65d112-320e-401f-a55b-ed39ab9a6f6d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:26.053016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e65d112-320e-401f-a55b-ed39ab9a6f6d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:26.054195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0e65d112-320e-401f-a55b-ed39ab9a6f6d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1281 microversion: 2.20 time: 0.232956 Jul 14 11:17:26.054771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 38/63] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:25 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:26.545285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:26.554824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:26.620549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:26.623165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:26.623165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:26.629517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:26.630994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:26.644150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:26.680029 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:26.680652 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:26.682415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:26.688140 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:26.975103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:26.990380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5f777acd-9ba5-414d-b0fc-b33248b8c367 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1281 microversion: 2.1 time: 0.379928 Jul 14 11:17:26.993261 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 39/64] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:26 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1281 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:27.076472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:27.077268 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:27.092390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:27.093010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:27.093902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:27.094459 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:27.227983 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:27.238109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:27.245111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:27.248081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-45e5c3c2-6237-4d18-a9ee-f22d44582573 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1285 microversion: 2.20 time: 0.175743 Jul 14 11:17:27.250975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 40/65] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:27 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:27.609419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:27.625305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-09fd4ed1-ef08-4f4e-9b5f-2e66676a6361 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 1.086318 Jul 14 11:17:27.639254 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 26/66] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:26 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:28.014731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:28.016592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:28.047296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.047296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.047296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.047296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.143578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-d9f2025a-44da-4b22-8ede-c11fd38b3768 req-248c74fa-cb2e-4690-8b5a-c43d5090f3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ab795c-d284-4373-a2de-e2632a1ad851", "tag": "dd15901b-4947-452b-b93e-fe5a295c43f8"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:28.207367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:28.214208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d9f2025a-44da-4b22-8ede-c11fd38b3768 req-248c74fa-cb2e-4690-8b5a-c43d5090f3b8 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.215520 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d9f2025a-44da-4b22-8ede-c11fd38b3768 req-248c74fa-cb2e-4690-8b5a-c43d5090f3b8 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.257230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-d9f2025a-44da-4b22-8ede-c11fd38b3768 req-248c74fa-cb2e-4690-8b5a-c43d5090f3b8 service nova] Creating event network-changed:dd15901b-4947-452b-b93e-fe5a295c43f8 for instance 01ab795c-d284-4373-a2de-e2632a1ad851 on hv-cinder-82282 Jul 14 11:17:28.259266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d9f2025a-44da-4b22-8ede-c11fd38b3768 req-248c74fa-cb2e-4690-8b5a-c43d5090f3b8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118245) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 11:17:28.260939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.267567 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.270708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.271635 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.293276 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.compute.rpcapi [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 11:17:28.295843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] Releasing lock "compute-rpcapi-router" {{(pid=118245) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 11:17:28.312528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:28.330975 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ad8195b4-f1c6-4b11-a8ad-2c737773332e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1279 microversion: 2.1 time: 0.321914 Jul 14 11:17:28.334265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f6bf8032-9030-4375-a720-284bb84f8069 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.740470 Jul 14 11:17:28.335355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 27/67] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:28 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1279 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:28.335687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 41/68] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:28.345707 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:28.350351 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:28.364563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.373968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.375899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.379604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.551031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:28.574524 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:28.576384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:28.577666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2175b472-9c16-419f-b8f7-0532f87dde7d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1333 microversion: 2.20 time: 0.241201 Jul 14 11:17:28.580162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 28/69] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:28 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1333 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:28.646245 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:28.646952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:28.658766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.659390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.661932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:28.662212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:28.941850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:28.972663 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c2d56017-52f0-4cda-8894-fb2ee257736c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.323007 Jul 14 11:17:28.975559 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 42/70] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:28 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:29.355468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:29.365121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:29.404225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:29.421015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:29.426478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:29.427856 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:29.600258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:29.602093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:29.627543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:29.628761 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:29.631676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:29.633198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:29.852194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:29.877570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:29.886596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:29.890216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ccc3174d-2992-4d04-9b4c-4b7dc2c78655 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1279 microversion: 2.1 time: 0.542364 Jul 14 11:17:29.891969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 29/71] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:29 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1279 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:29.896361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:29.897571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3615d132-a191-4dc5-a507-7f8e3c4a26e9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1333 microversion: 2.20 time: 0.303375 Jul 14 11:17:29.904833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 43/72] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:29 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1333 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:29.982971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:29.983532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:29.995195 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:29.995195 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:29.995507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:29.999834 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:30.569160 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:30.615484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f70df7d0-6499-46c8-8788-88d7b4233b4c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.630026 Jul 14 11:17:30.631879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 30/73] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:29 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:30.916963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:30.919381 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:30.932320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:30.933729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:30.934309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:30.935142 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:30.936763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:30.937896 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:30.980517 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:30.981260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:30.982063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:30.982509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:31.061451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:31.082339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-012d58d1-d4aa-4dfc-9613-91cd9f7334d0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1279 microversion: 2.1 time: 0.172531 Jul 14 11:17:31.083506 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 44/74] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:30 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:31.149178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:31.165601 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:31.167333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:31.168481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e6985eed-15ac-458a-b174-82c077891df1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1341 microversion: 2.20 time: 0.248134 Jul 14 11:17:31.169043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 31/75] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:30 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:31.640475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:31.641227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:31.651299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:31.651299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:31.665384 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:31.666626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:32.092798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:32.092798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-80166e02-a6ad-4890-9277-0a4345046cdd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.456774 Jul 14 11:17:32.092798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 45/76] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:31 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:32.109176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:32.109905 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:32.118730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:32.119658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:32.120966 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:32.121807 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:32.189410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:32.190928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:32.208373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:32.211596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:32.213022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:32.213613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:32.304366 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:32.316837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:32.320654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:32.323742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6f268b95-b1bb-4c12-8f2c-f0b819b4822d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1341 microversion: 2.20 time: 0.139301 Jul 14 11:17:32.324776 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 46/77] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:32 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1341 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:32.446126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:32.454744 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6bce9b8e-8d8e-45e0-83cf-9549f2f90a5d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.349139 Jul 14 11:17:32.458903 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 32/78] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:32 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:32.884942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-11781ab6-2603-42c8-adc9-7b6a982164c2 req-c7a46640-1739-45d8-825d-1ecb91785d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f384cec4-20d3-4f6d-aeee-62ee2b5abe41", "tag": "4e9f5953-94dc-4311-8014-999286bdb480"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:32.901939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-11781ab6-2603-42c8-adc9-7b6a982164c2 req-c7a46640-1739-45d8-825d-1ecb91785d72 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:32.906952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-11781ab6-2603-42c8-adc9-7b6a982164c2 req-c7a46640-1739-45d8-825d-1ecb91785d72 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:32.936243 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-11781ab6-2603-42c8-adc9-7b6a982164c2 req-c7a46640-1739-45d8-825d-1ecb91785d72 service nova] Creating event network-changed:4e9f5953-94dc-4311-8014-999286bdb480 for instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 on hv-cinder-82282 Jul 14 11:17:32.942733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-11781ab6-2603-42c8-adc9-7b6a982164c2 req-c7a46640-1739-45d8-825d-1ecb91785d72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.615651 Jul 14 11:17:32.944039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 47/79] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:33.116640 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:33.116640 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:33.124066 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:33.124924 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:33.125912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:33.126774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:33.343059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:33.344009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:33.363745 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:33.364533 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:33.365673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:33.366254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:33.430155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:33.438723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-befbd4b1-6bce-47de-9d50-ea97c0e965d9 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.333555 Jul 14 11:17:33.447978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 33/80] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:33 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:33.476206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:33.477079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:33.483780 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:33.484537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:33.485499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:33.486090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:33.494025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:33.505819 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:33.510976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:33.512786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:33.514089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3fca35f6-0660-4fea-b17b-c5614979e579 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1341 microversion: 2.20 time: 0.175665 Jul 14 11:17:33.514791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 48/81] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:33 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:33.640038 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:33.648084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ad86c854-3b86-403a-8a72-140345486b89 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.176915 Jul 14 11:17:33.648644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 34/82] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:33 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:34.457694 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:34.458328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:34.464460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:34.464914 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:34.465693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:34.466166 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:34.534390 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:34.535053 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:34.537247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=4 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:34.542167 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:34.551577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:34.551577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:34.551577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:34.607233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:34.615999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e896d6bf-2d01-4eda-880e-b393197f0849 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.162997 Jul 14 11:17:34.616566 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 49/83] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:34 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:34.648837 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:34.662132 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:34.664467 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:34.666660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-24b736d4-1ab4-4475-bb29-b593684ad883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1341 microversion: 2.20 time: 0.136103 Jul 14 11:17:34.666903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:34.667437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:34.681098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 35/84] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:34 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1341 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:34.683894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:34.684383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:34.688549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:34.689201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:34.868738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:34.876300 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9647e4e0-1b68-4ab4-8264-bda416dae51b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.214542 Jul 14 11:17:34.876956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 50/85] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:34 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:35.117021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-250d9138-9463-4598-82cd-03b3ec02636d req-22f14bf2-7207-4ddb-8987-47a066a65646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a714690c-6862-4797-8c84-e07c9262c217", "tag": "bff12a73-9dcb-415a-be41-a46436a20db6"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:35.120997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=22 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:35.130537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-250d9138-9463-4598-82cd-03b3ec02636d req-22f14bf2-7207-4ddb-8987-47a066a65646 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.131049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-250d9138-9463-4598-82cd-03b3ec02636d req-22f14bf2-7207-4ddb-8987-47a066a65646 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.153408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-250d9138-9463-4598-82cd-03b3ec02636d req-22f14bf2-7207-4ddb-8987-47a066a65646 service nova] Creating event network-changed:bff12a73-9dcb-415a-be41-a46436a20db6 for instance a714690c-6862-4797-8c84-e07c9262c217 on hv-cinder-82282 Jul 14 11:17:35.153966 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-250d9138-9463-4598-82cd-03b3ec02636d req-22f14bf2-7207-4ddb-8987-47a066a65646 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118244) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 11:17:35.155651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.156158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.156961 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.157478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.167686 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.compute.rpcapi [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 11:17:35.168634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=118244) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 11:17:35.196784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-857809ad-8daf-4cf3-b1ba-31904200c5f1 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086236 Jul 14 11:17:35.197578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 36/86] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:35.634158 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:35.634854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:35.641689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.642137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.643164 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.643492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.688852 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:35.690997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:35.701249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.711528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.711528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.711528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.775871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:35.784805 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:35.787436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:35.787542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dbb7a5a7-ae8f-4121-bd16-11ae97715041 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1341 microversion: 2.20 time: 0.106379 Jul 14 11:17:35.788050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 37/87] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:35 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1341 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:35.791722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:35.799087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8b34357b-0200-4e8b-9093-88a530ae7e91 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.169330 Jul 14 11:17:35.800422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 51/88] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:35 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:35.894505 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:35.895142 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:35.901153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.901607 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:35.902430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:35.903313 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:36.114321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:36.122289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-097e6133-6397-4f48-adcd-21d046674d68 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.232591 Jul 14 11:17:36.122873 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 38/89] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:35 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:36.806890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:36.807536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:36.809421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=20 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:36.818336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:36.819064 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:36.819764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:36.820419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:36.820724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:36.821316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:36.829303 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:36.829783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:36.831289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:36.831751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:36.837761 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:36.917779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:36.930244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:36.933936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:36.935646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-224f0ddd-862b-40b0-8a85-592a065e0b40 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1341 microversion: 2.20 time: 0.132605 Jul 14 11:17:36.936708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 52/90] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:36 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1341 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:37.141752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:37.144391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:37.153161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:37.154434 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:37.155546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:37.156202 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:37.399331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:37.407981 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8ebc8b37-dd0d-42c5-857a-6814bbd6a8ee tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.590017 Jul 14 11:17:37.408742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 39/91] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:36 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:37.669452 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:37.682455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7f973c5a-499b-4af1-905f-74421d833fe2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.544544 Jul 14 11:17:37.685659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 53/92] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:37 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:37.955067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:37.956873 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:37.965627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:37.966883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:37.968691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:37.969475 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.091868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:38.106165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:38.110730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:38.113335 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5efc3b77-0142-4dc4-b5ff-97dbff4a97fd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1339 microversion: 2.20 time: 0.163453 Jul 14 11:17:38.114863 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 40/93] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:37 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1339 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:38.427870 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:38.427870 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:38.433422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=4 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:38.434997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:38.435645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.436791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:38.437380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.661214 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:38.669881 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c4b644c7-3c0c-4c71-abde-4f3727fa3a76 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.248030 Jul 14 11:17:38.680470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 54/94] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:38 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:38.706347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:38.709107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:38.713644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:38.718117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:38.718657 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.719597 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:38.720259 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:38.863993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:38.878270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-569522e5-3722-4640-ac2c-f91efb5d4071 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.180300 Jul 14 11:17:38.888751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 41/95] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:38 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:39.132604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:39.133180 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:39.139088 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.139582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.140442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.140876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.327514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:39.336434 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:39.337964 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:39.346525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-62057943-2f42-4675-b731-53b7c5b5146c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.210510 Jul 14 11:17:39.346525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 55/96] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:39 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:39.692550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:39.696844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:39.705742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.706217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.707349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.707801 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.897038 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:39.897703 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:39.904205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.904656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.905413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:39.906070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:39.922215 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:39.931464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d961ab06-21af-46af-9aa0-ce0529267ee6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.247065 Jul 14 11:17:39.932979 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 42/97] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:39 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:40.119831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:40.139577 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-62c5adbd-e544-4a70-8779-7478df0ca33f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.247927 Jul 14 11:17:40.140113 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 56/98] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:39 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:40.358269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:40.359037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:40.366697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:40.367167 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:40.367939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:40.368369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:40.950766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:40.951432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:40.965209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:40.972197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:40.972197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:40.972197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:41.267004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:41.281962 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a1dd87e5-a032-488d-bb4b-f14ecad2ac59 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.331466 Jul 14 11:17:41.282154 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 57/99] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:40 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:41.290789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:41.300953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:41.313737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:41.314185 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:41.328059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:41.328518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:41.492263 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:41.505291 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:41.508296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:41.509840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-548472a3-318a-4018-89ee-8d55a7612b94 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 1.155721 Jul 14 11:17:41.522814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 43/100] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:40 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:41.785689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:41.810321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-20faf745-989d-49c5-a299-3a6720201fc8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.517018 Jul 14 11:17:41.810321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 58/101] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:41 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:42.299747 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:42.300824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:42.307378 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.307834 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.308617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.309215 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.350132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-8009a0d6-f04d-4be5-909a-9582c7c215f3 req-3a7cfabf-73ba-43f5-ac44-b63c283afffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:42.359822 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-8009a0d6-f04d-4be5-909a-9582c7c215f3 req-3a7cfabf-73ba-43f5-ac44-b63c283afffb service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.360356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-8009a0d6-f04d-4be5-909a-9582c7c215f3 req-3a7cfabf-73ba-43f5-ac44-b63c283afffb service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.374684 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-8009a0d6-f04d-4be5-909a-9582c7c215f3 req-3a7cfabf-73ba-43f5-ac44-b63c283afffb service nova] Creating event network-changed:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:17:42.382048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-8009a0d6-f04d-4be5-909a-9582c7c215f3 req-3a7cfabf-73ba-43f5-ac44-b63c283afffb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035850 Jul 14 11:17:42.383095 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 59/102] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:17:42.530746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:42.531652 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:42.541502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.542271 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.543355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.544310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.621477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:42.639312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bc17b9b6-4d42-4ce3-8cdc-936dc86d5b13 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.342842 Jul 14 11:17:42.644610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 44/103] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:42 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:42.747495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:42.759139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:42.761099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:42.762829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2a967745-2362-443a-86d9-859b0034d57b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.237337 Jul 14 11:17:42.763925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 60/104] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:42 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:42.822223 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:42.822223 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:42.832200 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.833179 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.834238 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:42.834895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:42.989487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:42.999915 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c5d0ffd1-51b7-4758-bd24-ce418bd51c01 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.185567 Jul 14 11:17:43.000525 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 45/105] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:42 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:43.660877 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:43.662317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:43.669828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:43.670308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:43.671075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:43.671544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:43.781690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:43.782661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:43.791607 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:43.791607 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:43.791607 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:43.792230 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:43.824101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:43.835181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ad9c1658-0245-425c-8e22-cd665dbadb20 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.180806 Jul 14 11:17:43.836345 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 61/106] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:43 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:44.018326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:44.021494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:44.022109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:44.030854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:44.031624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:44.032492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:44.034639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:44.038071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:44.039888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:44.041242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c3ae3ae8-fdbe-4f0c-af6e-f97ae2a545ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.263523 Jul 14 11:17:44.052092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 46/107] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:43 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:44.181669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:44.190453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6a115874-e209-4acc-af54-883e4d6cc5a9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.176134 Jul 14 11:17:44.191030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 62/108] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:44 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:44.853672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:44.854697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:44.871018 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:44.876211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:44.876211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:44.878743 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.001863 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-960d1c51-2cdf-4589-ba78-846f9067f873 req-922c79f5-70a8-46dc-8502-5cb54f733b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ab795c-d284-4373-a2de-e2632a1ad851", "name": "network-vif-plugged", "status": "completed", "tag": "dd15901b-4947-452b-b93e-fe5a295c43f8"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:45.025657 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-960d1c51-2cdf-4589-ba78-846f9067f873 req-922c79f5-70a8-46dc-8502-5cb54f733b31 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.026108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-960d1c51-2cdf-4589-ba78-846f9067f873 req-922c79f5-70a8-46dc-8502-5cb54f733b31 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.057331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-960d1c51-2cdf-4589-ba78-846f9067f873 req-922c79f5-70a8-46dc-8502-5cb54f733b31 service nova] Creating event network-vif-plugged:dd15901b-4947-452b-b93e-fe5a295c43f8 for instance 01ab795c-d284-4373-a2de-e2632a1ad851 on hv-cinder-82282 Jul 14 11:17:45.069271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-960d1c51-2cdf-4589-ba78-846f9067f873 req-922c79f5-70a8-46dc-8502-5cb54f733b31 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219911 Jul 14 11:17:45.071620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 47/109] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:45.092073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:45.092073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:45.097991 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.098446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.112966 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.121932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.380208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:45.388106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-30f37fbf-8f3a-4004-880a-6b5a739a9d0a tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.538845 Jul 14 11:17:45.389287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 63/110] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:44 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:45.403081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:45.408168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:45.411398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.411933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.412758 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:45.412917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:45.413445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:45.430297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:45.436715 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:45.437940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0c2e52c3-6866-45df-ab1a-7e2ea67d8422 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.364294 Jul 14 11:17:45.440018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 48/111] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:45 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:45.614462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:45.623110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5d70cc31-d01e-475d-8bf0-91431fcd7aa6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.232531 Jul 14 11:17:45.623832 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 64/112] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:45 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:46.406120 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:46.407438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:46.413708 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:46.415513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:46.416059 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:46.416859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:46.417451 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:46.465224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:46.466940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:46.477246 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:46.478147 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:46.479800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:46.481085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:46.605143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:46.615735 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d9c0ae9f-ae38-4c99-969f-e0780ab3238c tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.213917 Jul 14 11:17:46.616324 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 49/113] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:46 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:46.640252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:46.641115 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:46.645275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:46.647899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:46.648354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:46.649144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:46.649581 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:46.653790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:46.655418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:46.656643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8841efea-b03e-4d92-93d7-b4e5048964dc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.203022 Jul 14 11:17:46.657261 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 65/114] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:46 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:46.792474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:46.801546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-85d93c4c-f0d2-423e-a68f-a3fa28f9ae05 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.165111 Jul 14 11:17:46.802267 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 50/115] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:46 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:47.633177 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:47.633912 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:47.640168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:47.640693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:47.641521 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:47.642044 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:47.646891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:47.676626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:47.677255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:47.690210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:47.691049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:47.692146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:47.693000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:47.854549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:47.864068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d51dd903-eeaa-4abd-bebb-7da87c99cfd6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.234438 Jul 14 11:17:47.874412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 66/116] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:47 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:47.880095 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:47.880700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:47.888007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:47.888466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:47.889262 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:47.889705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:47.899045 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:47.918531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:47.921360 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:47.924266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d566e3de-d824-4966-b42f-daa372ab0376 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.252029 Jul 14 11:17:47.925184 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 51/117] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:47 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:48.120665 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:48.138660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f33e07ce-648e-4d9e-9d48-1410d86979f6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.263045 Jul 14 11:17:48.144365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 67/118] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:47 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:48.314474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-769db124-340e-470b-9b64-e3505f9deea6 req-493d3682-0e64-4e59-9ebc-c797513e2bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f384cec4-20d3-4f6d-aeee-62ee2b5abe41", "name": "network-vif-plugged", "status": "completed", "tag": "4e9f5953-94dc-4311-8014-999286bdb480"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:48.329916 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-769db124-340e-470b-9b64-e3505f9deea6 req-493d3682-0e64-4e59-9ebc-c797513e2bd4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:48.340173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-769db124-340e-470b-9b64-e3505f9deea6 req-493d3682-0e64-4e59-9ebc-c797513e2bd4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:48.355388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-769db124-340e-470b-9b64-e3505f9deea6 req-493d3682-0e64-4e59-9ebc-c797513e2bd4 service nova] Creating event network-vif-plugged:4e9f5953-94dc-4311-8014-999286bdb480 for instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 on hv-cinder-82282 Jul 14 11:17:48.367534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-769db124-340e-470b-9b64-e3505f9deea6 req-493d3682-0e64-4e59-9ebc-c797513e2bd4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054788 Jul 14 11:17:48.369236 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 52/119] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:48.885668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:48.885668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:48.890812 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:48.891414 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:48.892828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:48.893341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:48.946019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:48.947325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:48.956276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:48.956999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:48.959385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:48.960100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:49.073607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:49.084439 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-09490d12-05f7-4855-8783-7291d7176041 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.205629 Jul 14 11:17:49.091339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 68/120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:48 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:49.123033 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:49.132605 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:49.134158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:49.135391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-31f24851-e63f-4a98-8868-38d71e6f0eee tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.196509 Jul 14 11:17:49.135983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 53/121] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:48 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:49.161043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:49.161673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:49.168008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:49.168462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:49.169236 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:49.169736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:49.372579 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:49.381476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d39a59f1-09ce-441a-8160-3be6af4e9d00 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.225121 Jul 14 11:17:49.385347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 69/122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:49 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:50.113083 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:50.122235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:50.129408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:50.131318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:50.135852 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:50.136259 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:50.157119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:50.158523 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:50.171577 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:50.175442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:50.176509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:50.180101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:50.397333 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:50.402034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:50.406675 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:50.408298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:50.409448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9e6975ae-86e5-428d-b87c-eb26773ab2d1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.258781 Jul 14 11:17:50.409780 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-58c0c597-ce06-49ce-8d8d-4e866ff0c9e0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.311612 Jul 14 11:17:50.410000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 70/123] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:50 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:50.413964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 54/124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:50 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:50.414335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:50.414938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:50.420823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:50.421275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:50.422033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:50.422467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:50.611199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:50.622939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2e290dd4-2b86-4a07-a8db-b180d4565276 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.211822 Jul 14 11:17:50.624142 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 71/125] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:50 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:51.430413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:51.431028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:51.437754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:51.439052 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:51.463226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:51.464949 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:51.465402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:51.466189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:51.466618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:51.472104 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:51.473396 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:51.474170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:51.671705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:51.694453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:51.696025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:51.697189 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4108db03-64bd-4047-b392-a733ecc04a42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.263619 Jul 14 11:17:51.700868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 72/126] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:51 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:51.705933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:51.706224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:51.713281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:51.713481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:51.713864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:51.714297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:51.714777 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:51.733804 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-18c36210-ffc4-46bb-8387-a626f76f3dc8 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.307359 Jul 14 11:17:51.743933 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 55/127] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:51 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:51.869207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:51.885467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3a0374fe-640d-4ed6-97f4-ab0564caf40e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.179204 Jul 14 11:17:51.885467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 73/128] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:51 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:52.735040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:52.736867 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:52.754844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:52.756219 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:52.756219 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:52.756783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:52.757861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:52.758775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:52.770554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:52.775422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:52.781479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:52.781479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:52.978068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:53.005502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:53.011809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:53.015912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ccc40e9b-8f49-4109-8d3b-d5e145b141da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.288514 Jul 14 11:17:53.029037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 56/129] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:52 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:53.043396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:53.045102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:53.059922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.065583 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.065583 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.065583 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.066193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:53.081324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-93ed4b29-78a0-42cd-8448-4ce48e195237 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1315 microversion: 2.1 time: 0.334518 Jul 14 11:17:53.082026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 74/130] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:52 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:53.087056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:53.205332 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-1eaa75bc-78d3-4a46-9180-aacaf97f77e2 req-e61ba8bf-022f-491d-bdd1-12ecdb6c7fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a714690c-6862-4797-8c84-e07c9262c217", "name": "network-vif-plugged", "status": "completed", "tag": "bff12a73-9dcb-415a-be41-a46436a20db6"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:53.227649 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-1eaa75bc-78d3-4a46-9180-aacaf97f77e2 req-e61ba8bf-022f-491d-bdd1-12ecdb6c7fb5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:53.227747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-1eaa75bc-78d3-4a46-9180-aacaf97f77e2 req-e61ba8bf-022f-491d-bdd1-12ecdb6c7fb5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:53.252636 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-1eaa75bc-78d3-4a46-9180-aacaf97f77e2 req-e61ba8bf-022f-491d-bdd1-12ecdb6c7fb5 service nova] Creating event network-vif-plugged:bff12a73-9dcb-415a-be41-a46436a20db6 for instance a714690c-6862-4797-8c84-e07c9262c217 on hv-cinder-82282 Jul 14 11:17:53.262710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-1eaa75bc-78d3-4a46-9180-aacaf97f77e2 req-e61ba8bf-022f-491d-bdd1-12ecdb6c7fb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061989 Jul 14 11:17:53.263754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 75/131] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:53.309578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:53.319171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dbb7559f-f37c-4865-8947-573d16be85c6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.288054 Jul 14 11:17:53.319930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 57/132] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:53 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:54.049178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:54.056985 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:54.057637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.058276 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.059263 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.059917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.100369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:54.102271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:54.108936 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.109382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.110717 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.111558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.287033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:54.299223 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:54.301913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:54.306277 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-55119294-6538-4791-b804-4e3940e54ab9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.259291 Jul 14 11:17:54.308809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 76/133] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:54 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:54.348672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:54.349714 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:54.373550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.374067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.375314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:54.377252 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:54.458510 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:54.481151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5cfc8d64-2c44-45b0-9fd8-df4e40128b53 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1501 microversion: 2.1 time: 0.385052 Jul 14 11:17:54.482178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 58/134] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:54 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1501 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:54.649092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:54.660467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4d96ff30-a1d2-4944-8841-1f8d7bf5100e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.324845 Jul 14 11:17:54.661233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 77/135] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:54 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:17:55.333574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.334599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.377754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.379540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.380971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.381847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.681236 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:55.682538 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:55.693249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.698443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.699660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:55.700459 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:55.727070 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:55.750298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:55.757121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:55.759610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d8afb0b5-4059-43bb-9e54-02206d37fab5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.433213 Jul 14 11:17:55.761022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 59/136] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:55 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:56.058684 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:56.071775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2003e9ef-bd48-42ef-a0e1-c9cd5cec55a7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.394677 Jul 14 11:17:56.072427 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 78/137] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:55 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:56.783442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:56.784469 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:56.791854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:56.792302 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:56.793087 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:56.793531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:56.961957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:56.971632 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:56.973139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:56.974329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-eecd06b7-69bd-4760-ae05-f2687dc5a859 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.195924 Jul 14 11:17:56.975312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 60/138] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:56 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:57.090104 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:57.090937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:57.099322 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:57.100193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:57.101344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:57.102227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:57.302975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:57.312082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2af8b920-164f-4d03-b7b2-74b580d86859 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.226038 Jul 14 11:17:57.314334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 79/139] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:57 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:57.950967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-ba9575dc-ac42-4841-a365-a1ec6ce6b60f req-c822971a-8d2b-42a7-8c21-3a9b7c248853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "name": "network-vif-plugged", "status": "completed", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:57.986413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-ba9575dc-ac42-4841-a365-a1ec6ce6b60f req-c822971a-8d2b-42a7-8c21-3a9b7c248853 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:57.987139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-ba9575dc-ac42-4841-a365-a1ec6ce6b60f req-c822971a-8d2b-42a7-8c21-3a9b7c248853 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.000775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:58.001916 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:58.023212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-ba9575dc-ac42-4841-a365-a1ec6ce6b60f req-c822971a-8d2b-42a7-8c21-3a9b7c248853 service nova] Creating event network-vif-plugged:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:17:58.032538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-ba9575dc-ac42-4841-a365-a1ec6ce6b60f req-c822971a-8d2b-42a7-8c21-3a9b7c248853 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091761 Jul 14 11:17:58.033923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 61/140] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:17:58.034551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.035261 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.036489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.044131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.309561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57d20a98-1cf7-40bd-ae43-54557620bf9a"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:17:58.321627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:58.332581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:58.338595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.339527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.341307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.342208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.369192 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:58.371416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:58.380965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-89e81195-6bca-4b6c-b612-7aeb0cc7b015 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.388955 Jul 14 11:17:58.382452 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 80/141] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:57 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:17:58.388222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:58.390459 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:58.400065 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.401365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.402378 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:58.404391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:58.707914 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:58.719965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ff5e659a-21de-4dc6-bb6b-9854f3227a5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1321 microversion: 2.1 time: 0.335267 Jul 14 11:17:58.720954 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 81/142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:58 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:17:59.403591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:59.409340 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:59.417923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.418897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.420607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.421633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.659113 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:59.682719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:59.686714 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:17:59.691475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2a057794-1bc3-4506-9d44-51a4181e9af4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.293929 Jul 14 11:17:59.716046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 82/143] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:17:59 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:17:59.744170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:17:59.745686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:17:59.755862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=84 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:59.759204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.760481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.762169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:17:59.763511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:17:59.800657 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:00.028294 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:00.049826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-32d63eda-3476-4fb1-af4a-d3dc03a2b6eb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1516 microversion: 2.1 time: 0.313544 Jul 14 11:18:00.051284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 83/144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:17:59 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:00.070601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:00.071628 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:00.083557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.084117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.085002 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.085476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.208454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'flavor' on Instance uuid a714690c-6862-4797-8c84-e07c9262c217 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:18:00.973919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e003071f-f4e9-4156-90fd-dd9ae393db72 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217/action" status: 200 len: 32 microversion: 2.1 time: 0.907980 Jul 14 11:18:00.974991 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 84/145] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:18:00 2022] POST /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217/action => generated 32 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 11:18:00.985387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:00.986356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:00.993947 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.994395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:00.995207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:00.995677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:01.233200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:01.244928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:01.246904 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:01.251270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-20ae9b35-0e9a-4be8-9e2c-7b882dcc93b5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.272088 Jul 14 11:18:01.251270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 85/146] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:00 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:18:01.255439 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:01.256420 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:01.263649 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:01.264103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:01.264903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:01.265330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:01.441968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:01.450568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-12753381-01be-4f1e-84e8-c6bf5fd9f2d8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.200397 Jul 14 11:18:01.451233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 86/147] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:01 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:02.266543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:02.267271 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:02.273311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.273764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.274536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.274973 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.480218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:02.491023 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:02.493171 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:02.494810 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-47bfbc6e-96a5-422e-be15-67b3d9e55a0a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.232333 Jul 14 11:18:02.495653 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 87/148] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:02 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:18:02.502071 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:02.502974 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:02.511067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.511667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.512570 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:02.513100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:02.710055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:02.719501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6bbc9006-9b69-449f-a208-85c55130a6cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.222284 Jul 14 11:18:02.720344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 88/149] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:02 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:03.526526 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:03.528836 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:03.548209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:03.549207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:03.550985 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:03.552336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:03.746327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:03.756798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:03.758339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:03.759472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c397d39b-dbb6-4ce0-9109-740f72d4f907 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.245857 Jul 14 11:18:03.760071 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 89/150] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:03 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:18:03.764448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:03.765048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:03.772509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:03.772958 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:03.773825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:03.774258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:03.954565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:03.969595 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ceb1b4de-e562-4f3d-bacb-8ae1cd0205fb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.207259 Jul 14 11:18:03.971092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 90/151] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:03 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:04.782612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:04.785102 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:04.794412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:04.795068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:04.795994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:04.797399 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.002229 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.010858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.012443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.013578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-04b892f4-f20c-4b91-942e-3766098fdb86 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.238481 Jul 14 11:18:05.014234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 91/152] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:04 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:18:05.022747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:05.023414 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:05.030203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.030659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.031992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:05.032418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:05.221533 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:05.230518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-712372a1-31da-47f7-9a65-455a19082bb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.215238 Jul 14 11:18:05.231099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 92/153] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:05 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:06.054234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:06.055204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:06.061341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.061800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.063639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.064078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.272072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:06.274746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b21924a8-0bab-4c50-a576-d7fbb497eba6 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "POST /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.975648 Jul 14 11:18:06.274746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 62/154] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:17:58 2022] POST /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851/os-volume_attachments => generated 194 bytes in 7978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:18:06.279744 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:06.280873 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:06.287014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:06.288891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:06.290146 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5d35d631-b6ed-45b3-9dc3-27dbb7979b75 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1406 microversion: 2.20 time: 0.240079 Jul 14 11:18:06.290987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 93/155] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:06 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:18:06.306110 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.306892 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.308182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:06.311610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:06.611166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:06.625830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d539d305-5ada-4dd9-bb86-ea9e54915855 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.350487 Jul 14 11:18:06.626908 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 63/156] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:06 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:07.309083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:07.309717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:07.319052 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.319780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.320727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.321243 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.652912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:07.654065 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:07.665814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.666522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.667769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.668434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.757287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:07.766149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:07.767716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:07.768925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2fef3cc1-098f-40a4-aea0-960c9fbe887a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1599 microversion: 2.20 time: 0.464021 Jul 14 11:18:07.769489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 94/157] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:18:07 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1599 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:18:07.794396 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:07.795294 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:07.805966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.808608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.808608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:07.809721 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:07.951373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-94011746-f638-4f3d-adc3-ce5435907e28 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.164751 Jul 14 11:18:07.954180 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 95/158] 10.222.0.59 () {60 vars in 1315 bytes} [Thu Jul 14 11:18:07 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:18:08.154611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:08.169335 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e3536b5e-2082-48e7-bdb8-04cec0487a73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.522781 Jul 14 11:18:08.170985 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 64/159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:07 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:09.189625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:09.190618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:09.199005 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:09.199614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:09.200668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:09.201276 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:09.521326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:09.536651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9f941520-b36d-4b6c-91e8-339b8909330f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.351203 Jul 14 11:18:09.538283 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 96/160] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:09 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:10.273005 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-04685e83-4dd4-4536-ad13-b4545fb8c43b req-150852e0-ec75-4101-b3eb-4e440f27ce49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:10.290624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-04685e83-4dd4-4536-ad13-b4545fb8c43b req-150852e0-ec75-4101-b3eb-4e440f27ce49 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:10.291172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-04685e83-4dd4-4536-ad13-b4545fb8c43b req-150852e0-ec75-4101-b3eb-4e440f27ce49 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:10.308206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-04685e83-4dd4-4536-ad13-b4545fb8c43b req-150852e0-ec75-4101-b3eb-4e440f27ce49 service nova] Creating event network-changed:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:18:10.314835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-04685e83-4dd4-4536-ad13-b4545fb8c43b req-150852e0-ec75-4101-b3eb-4e440f27ce49 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049760 Jul 14 11:18:10.315633 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 65/161] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:18:10.563932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:10.564956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:10.572911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:10.573657 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:10.574639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:10.575236 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:10.848646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:10.864365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ca216bce-ba3f-422e-84d9-9b867c7297d3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.305623 Jul 14 11:18:10.882111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 97/162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:10 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:11.886679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:11.887395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:11.890262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=50 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:11.896532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:11.897053 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:11.897911 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:11.898443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:12.159164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:12.171913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d0d2d0b7-a14a-4099-91d0-6a6686017ec0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.288615 Jul 14 11:18:12.172727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 66/163] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:11 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:13.200993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:13.204055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:13.215494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:13.216229 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:13.217309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:13.218961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:13.251629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:13.413839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:13.421701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a0bb39c4-6e12-4a73-9f05-48753c8df0e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.233155 Jul 14 11:18:13.422296 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 98/164] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:13 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:14.439186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:14.439915 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:14.451339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:14.451339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:14.451339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:14.451339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:14.619049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:14.633586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-27378c80-d919-4ac3-9a6d-39fa452725f9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.198597 Jul 14 11:18:14.634989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 67/165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:14 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:15.661089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:15.661812 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:15.668934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:15.669455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:15.670375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:15.670786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:15.843275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:15.851895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cf529f49-e59f-433d-876d-93b454081633 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.195988 Jul 14 11:18:15.852495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 99/166] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:15 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:16.872146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:16.872748 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:16.881332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:16.881918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:16.882703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:16.883172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:17.092514 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:17.106360 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-be11b703-d0c2-4c7b-a005-bd381b1d1984 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.238276 Jul 14 11:18:17.107292 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 68/167] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:16 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:18.131488 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:18.132792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:18.146137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:18.146590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:18.147587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:18.148354 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:18.330086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:18.338850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-66169411-56fd-4d87-8940-c0142914ef4e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.215226 Jul 14 11:18:18.339830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 100/168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:18 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:19.361773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:19.364234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:19.373952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:19.374785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:19.375929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:19.376640 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:19.570724 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:19.585188 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8166de9f-e779-4629-b9ca-bbbff6277661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.230028 Jul 14 11:18:19.586727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 69/169] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:19 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:20.604193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:20.604834 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:20.616095 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:20.616863 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:20.618212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:20.619201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:20.828536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:20.848775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-47d79c77-969f-4561-a6af-c155fbde4718 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.247931 Jul 14 11:18:20.854238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 101/170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:20 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:21.880468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:21.881204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:21.889338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:21.890130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:21.891523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:21.892286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:22.083166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:22.101922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e47618c7-66f9-4698-9722-cfb6f84bbf34 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.226916 Jul 14 11:18:22.102956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 70/171] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:21 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:23.131746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:23.133267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:23.145228 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:23.146093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:23.147978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:23.149375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:23.340472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:23.348877 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0b40d22e-2924-4fc4-9a72-52481d6193c3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.223137 Jul 14 11:18:23.349623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 102/172] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:23 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:24.366773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:24.367456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:24.377773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:24.378237 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:24.379023 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:24.379489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:24.382166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:24.539306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:24.548843 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6f3cebad-4822-46b4-a2e9-451dd3517da8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.185854 Jul 14 11:18:24.549662 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 71/173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:24 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:25.567780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:25.568813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:25.579246 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:25.579980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:25.581227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:25.581931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:25.730943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:25.739929 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0f216085-ad75-4f64-84f4-68836f560b9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.176661 Jul 14 11:18:25.740520 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 103/174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:25 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:26.320271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:26.321046 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:26.329149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:26.329855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:26.331089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:26.331817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:26.364274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:18:26.745592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a7ce329f-c584-486d-8dfb-466223286dbd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "DELETE /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 204 len: 0 microversion: 2.1 time: 0.429596 Jul 14 11:18:26.746189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 72/175] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:26 2022] DELETE /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:18:26.758299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:26.759318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:26.762088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:26.763325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:26.769064 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:26.769619 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:26.770487 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:26.771006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:26.774175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:26.774693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:26.775808 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:26.776539 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:26.956309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:26.965868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:26.969266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7d43ee85-e6be-4a49-9998-440daeadc02a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.214027 Jul 14 11:18:26.970145 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 73/176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:26 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:26.978749 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-17218c3a-1697-4ee5-a861-bc23c39c9f60 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1553 microversion: 2.1 time: 0.226760 Jul 14 11:18:26.980124 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 104/177] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:26 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:27.996301 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:27.997234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:28.000565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:28.001560 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:28.005513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:28.005921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:28.006718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:28.007205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:28.011992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:28.013642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:28.015021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:28.015818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:28.203984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:28.210426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:28.216262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-914a1414-13b4-47c0-86fa-5d1e21ec8ea3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.223796 Jul 14 11:18:28.217526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 74/178] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:27 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:28.222138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ce2f15f8-d4f3-48c2-a726-3b50b967a5ff tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1553 microversion: 2.1 time: 0.227157 Jul 14 11:18:28.222138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 105/179] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:27 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:29.237426 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:29.240651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:29.242745 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:29.243800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:29.248677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:29.249404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:29.250697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:29.251490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:29.256595 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:29.257321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:29.258751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:29.259463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:29.451798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:29.456241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:29.464775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a255b4fc-3675-472d-a0bd-31bc08753382 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1553 microversion: 2.1 time: 0.229017 Jul 14 11:18:29.465524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 106/180] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:29 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:29.466307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1454b23b-5832-4b90-8a76-db5a8d46d26d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.235471 Jul 14 11:18:29.467531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 75/181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:29 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:30.491193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:30.495984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:30.497868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:30.499393 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:30.507412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=48 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:30.509583 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:30.515281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:30.516097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:30.517811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:30.518608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:30.524578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:30.527401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:30.527401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:30.745316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:30.755671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1d7f0a23-b95f-4b44-aac4-0cd999452a32 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1553 microversion: 2.1 time: 0.269584 Jul 14 11:18:30.756287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 107/182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:30 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:30.783163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:30.792111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-08a4e2d1-f512-43b3-a6f9-4420dfbb2a50 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.305136 Jul 14 11:18:30.792962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 76/183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:30 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:31.785771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:31.786910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:31.799451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:31.800418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:31.802401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:31.803490 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:31.818272 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:31.819181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:31.838164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:31.844453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:31.844453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:31.844453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:32.044240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:32.054308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-de33ef47-b7d3-49ee-ad40-47885659103f tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1553 microversion: 2.1 time: 0.275136 Jul 14 11:18:32.055446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 108/184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:31 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:32.227258 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:32.236989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-df1d705a-de0a-4683-9b52-af609d104a3b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.428484 Jul 14 11:18:32.238507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 77/185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:31 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:32.855984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-76573d47-62b3-43d0-9150-b9ba28eafb97 req-524699f1-01cd-4d6b-8df0-e61272a0ec9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ab795c-d284-4373-a2de-e2632a1ad851", "name": "network-vif-deleted", "tag": "dd15901b-4947-452b-b93e-fe5a295c43f8"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:32.889915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-76573d47-62b3-43d0-9150-b9ba28eafb97 req-524699f1-01cd-4d6b-8df0-e61272a0ec9b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:32.889915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-76573d47-62b3-43d0-9150-b9ba28eafb97 req-524699f1-01cd-4d6b-8df0-e61272a0ec9b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:32.907006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-76573d47-62b3-43d0-9150-b9ba28eafb97 req-524699f1-01cd-4d6b-8df0-e61272a0ec9b service nova] Creating event network-vif-deleted:dd15901b-4947-452b-b93e-fe5a295c43f8 for instance 01ab795c-d284-4373-a2de-e2632a1ad851 on hv-cinder-82282 Jul 14 11:18:32.915805 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-76573d47-62b3-43d0-9150-b9ba28eafb97 req-524699f1-01cd-4d6b-8df0-e61272a0ec9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066239 Jul 14 11:18:32.917127 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 109/186] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:18:33.083888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:33.084935 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:33.094712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:33.095381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:33.096455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:33.096969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:33.177925 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:33.190931 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6af1f297-d983-44b7-abdb-0afb8cd4b3af tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1346 microversion: 2.1 time: 0.114657 Jul 14 11:18:33.191610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 78/187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:33 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:33.268616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:33.269411 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:33.276885 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:33.277338 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:33.282081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:33.282081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:33.465905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:33.477928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ffa268be-d867-448e-af60-589d05c99404 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.215619 Jul 14 11:18:33.485771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 110/188] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:33 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:34.208983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:34.209581 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:34.222108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:34.222882 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:34.224071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:34.224756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:34.318626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:34.328938 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9a262d27-7ab5-41b6-96a4-a61b1d5075bd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1346 microversion: 2.1 time: 0.123828 Jul 14 11:18:34.329532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 79/189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:34 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:34.501585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:34.502238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:34.509166 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:34.509166 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:34.509886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:34.510332 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:34.705444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:34.726508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-82b87f34-ac3b-465a-a06a-5fdcbb672661 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.229772 Jul 14 11:18:34.738165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 111/190] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:34 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:35.348384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:35.349417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:35.357127 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:35.357618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:35.358420 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:35.358873 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:35.406368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:35.406797 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:35.407331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lazy-loading 'fault' on Instance uuid 01ab795c-d284-4373-a2de-e2632a1ad851 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:18:35.464084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c8ce3b0a82f47dc9ae6a4fb2abcaeaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457a247df22a45b39318dd2add051120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:35.476202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5318a677-5171-4e85-b517-3e4fb48f9ae0 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 200 len: 1351 microversion: 2.1 time: 0.132043 Jul 14 11:18:35.476879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 80/191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:35 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 1351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:35.782441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:35.783756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:35.794056 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:35.794348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:35.795258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:35.795864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:36.033276 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:36.046575 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-567eefe2-fc26-4fed-9e37-27bc024ecb33 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.269209 Jul 14 11:18:36.059696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 112/192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:35 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:36.497117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:36.498119 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:36.506549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:36.507242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:36.508295 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:36.508912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:36.526391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] HTTP exception thrown: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Request method failure captured: Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 HTTP/1.1 Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_syY2a7Q_RoH1REiXnbZeYR4xAznTFjT-0pJjlzGqTpv2BlC-S00ltqLXNTD3dJ5g6hLCBMaFx-zE2eLxwn74ZPCr8TDDXZleCeOZWGR2ocuFSfAnEpjV08_DzOkt6qA5B83EvufyIsdj5dbN5wD7swcH1VTFo0lUR0XPjNM7dfOBU Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:18:36.532944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_457a247df22a45b39318dd2add051120", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/457a247df22a45b39318dd2add051120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 2c8ce3b0a82f47dc9ae6a4fb2abcaeaa Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.535357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '01ab795c-d284-4373-a2de-e2632a1ad851'} Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:36.536144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.537249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.538363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Returning 404 to user: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:36.538363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-431448bb-2077-46a2-b64e-3e9546faf2f3 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 404 len: 111 microversion: 2.1 time: 0.042572 Jul 14 11:18:36.538363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 81/193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:36 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:36.679363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:36.680277 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:36.687505 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:36.687946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:36.688734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:36.689160 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:36.703462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] HTTP exception thrown: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Request method failure captured: Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851/os-volume_attachments HTTP/1.1 Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_syY2a7Q_RoH1REiXnbZeYR4xAznTFjT-0pJjlzGqTpv2BlC-S00ltqLXNTD3dJ5g6hLCBMaFx-zE2eLxwn74ZPCr8TDDXZleCeOZWGR2ocuFSfAnEpjV08_DzOkt6qA5B83EvufyIsdj5dbN5wD7swcH1VTFo0lUR0XPjNM7dfOBU Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:18:36.707494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_457a247df22a45b39318dd2add051120", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/457a247df22a45b39318dd2add051120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 2c8ce3b0a82f47dc9ae6a4fb2abcaeaa Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.709099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'server_id': '01ab795c-d284-4373-a2de-e2632a1ad851'} Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:36.710030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:36.711515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:36.712966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Returning 404 to user: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:36.712966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d5db87d0-7d09-4e02-8f21-4d6012904ba5 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033544 Jul 14 11:18:36.712966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 113/194] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:18:36 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:37.066668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:37.067818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:37.079878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:37.081392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:37.082742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:37.083627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:37.329182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:37.336883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b5d4a85e-8156-4285-b7a4-ae8541c5d23f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.274982 Jul 14 11:18:37.337589 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 82/195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:37 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:38.362599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:38.363283 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:38.369992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:38.370509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:38.372132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:38.372654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:38.582636 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:38.595508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-539aa2f1-7e11-419c-ab13-82a04b34e79f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.237505 Jul 14 11:18:38.596552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 114/196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:38 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:18:38.622194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:38.622194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:38.629403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:38.629868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:38.630624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:38.631053 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:38.645622 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] HTTP exception thrown: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Request method failure captured: Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: DELETE /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 HTTP/1.1 Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_syY2a7Q_RoH1REiXnbZeYR4xAznTFjT-0pJjlzGqTpv2BlC-S00ltqLXNTD3dJ5g6hLCBMaFx-zE2eLxwn74ZPCr8TDDXZleCeOZWGR2ocuFSfAnEpjV08_DzOkt6qA5B83EvufyIsdj5dbN5wD7swcH1VTFo0lUR0XPjNM7dfOBU Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:18:38.648309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_457a247df22a45b39318dd2add051120", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/457a247df22a45b39318dd2add051120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 2c8ce3b0a82f47dc9ae6a4fb2abcaeaa Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.649846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '01ab795c-d284-4373-a2de-e2632a1ad851'} Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:38.650920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.652221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.653453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Returning 404 to user: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:38.653453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a9bf8c9e-195b-49f0-ab27-7630a85e56cd tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "DELETE /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 404 len: 111 microversion: 2.1 time: 0.031541 Jul 14 11:18:38.653453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 83/197] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:18:38 2022] DELETE /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:18:38.658261 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:38.658869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] [instance: 01ab795c-d284-4373-a2de-e2632a1ad851] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:38.665115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:38.665492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:38.666458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:38.666930 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:38.681961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] HTTP exception thrown: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Request method failure captured: Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 HTTP/1.1 Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_syY2a7Q_RoH1REiXnbZeYR4xAznTFjT-0pJjlzGqTpv2BlC-S00ltqLXNTD3dJ5g6hLCBMaFx-zE2eLxwn74ZPCr8TDDXZleCeOZWGR2ocuFSfAnEpjV08_DzOkt6qA5B83EvufyIsdj5dbN5wD7swcH1VTFo0lUR0XPjNM7dfOBU Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:18:38.685445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_457a247df22a45b39318dd2add051120", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/457a247df22a45b39318dd2add051120"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/457a247df22a45b39318dd2add051120"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 457a247df22a45b39318dd2add051120 Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-DeleteServersTestJSON-764460780 Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 2c8ce3b0a82f47dc9ae6a4fb2abcaeaa Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-DeleteServersTestJSON-764460780-project Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.688209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '01ab795c-d284-4373-a2de-e2632a1ad851'} Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:18:38.689923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. Jul 14 11:18:38.692455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:18:38.694587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] Returning 404 to user: Instance 01ab795c-d284-4373-a2de-e2632a1ad851 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:18:38.694587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-35dcadf1-3022-4d76-b282-49f975e34d35 tempest-DeleteServersTestJSON-764460780 tempest-DeleteServersTestJSON-764460780-project] 10.222.0.59 "GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851" status: 404 len: 111 microversion: 2.1 time: 0.032845 Jul 14 11:18:38.694587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 115/198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:38 2022] GET /compute/v2.1/servers/01ab795c-d284-4373-a2de-e2632a1ad851 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:39.616574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:39.617252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:39.623952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:39.624483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:39.625354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:39.625891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:39.785188 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:39.794090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-78747719-8518-48f8-9725-419658c3701f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.181315 Jul 14 11:18:39.794904 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 84/199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:39 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:40.812221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:40.813077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:40.819522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:40.819979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:40.820772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:40.821206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:41.098345 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:41.108235 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-14697dca-97c5-4018-954e-15009b138e95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.300472 Jul 14 11:18:41.124351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 116/200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:40 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:42.140085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:42.140085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:42.144096 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:42.145876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:42.146762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:42.147399 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:42.147828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:42.693941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:42.710612 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b46231b8-0cd1-4d7f-85ba-f7687d673316 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.584660 Jul 14 11:18:42.711578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 85/201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:42 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:43.732087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:43.733269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:43.742443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:43.749479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:43.750425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:43.751064 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:43.804844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:44.078403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:44.090770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-822f4d20-c131-4348-8ed7-e1da9aeb9200 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.364845 Jul 14 11:18:44.101768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 117/202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:43 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:45.109644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:45.110271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:45.119599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:45.123263 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:45.123263 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:45.123263 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:45.412585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:45.432746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-83351bee-9424-4f78-bc1a-e738cad71624 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.327849 Jul 14 11:18:45.435385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 86/203] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:45 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:46.453101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:46.454319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:46.462081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:46.477016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:46.477016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:46.477016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:46.662809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:46.673198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f4ca1eb7-64c7-4171-ab77-4ee3a72d74a6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.224988 Jul 14 11:18:46.675244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 118/204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:46 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:47.691290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:47.692674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:47.710577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:47.712387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:47.715296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:47.728822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:47.734725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:48.014363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:48.027878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-44179f2c-676a-4a94-9897-4e8c21a97108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.340995 Jul 14 11:18:48.041275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 87/205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:47 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:49.046359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:49.047158 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:49.061097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:49.061648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:49.063756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:49.063877 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:49.356924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:49.373344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-796f2c81-c9d7-437e-8bde-7a4d9255cfe0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.331620 Jul 14 11:18:49.375163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 119/206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:49 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:50.391150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:50.392031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:50.408419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:50.410242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:50.412085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:50.412838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:51.143712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:51.156915 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-59a848e7-5dc2-45cf-b258-a0ccd5f34212 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.770095 Jul 14 11:18:51.157506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 88/207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:50 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:52.190464 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:52.191151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:52.208249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:52.208971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:52.211058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:52.217303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:52.663928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:52.679616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-aa05d1e7-d715-44f6-9c51-5d7a264cb6e5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1522 microversion: 2.1 time: 0.507973 Jul 14 11:18:52.683493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 120/208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:52 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:53.702702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:53.703741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:53.738121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:53.746506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:53.748861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:53.752468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:55.143334 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:55.160642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-84feaa12-45d6-4cc1-bb23-fc9af909c846 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1502 microversion: 2.1 time: 1.463368 Jul 14 11:18:55.164173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 89/209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:53 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1502 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:55.179626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:55.185293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:55.190754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:55.190939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:55.196103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:55.196103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:55.474436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:18:55.484804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dec2c6b4-2ab1-4064-9e28-71b3f890af44 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1516 microversion: 2.1 time: 0.308943 Jul 14 11:18:55.485399 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 121/210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:55 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:18:58.763665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:58.765563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:58.780910 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:58.784189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:58.787601 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:58.788512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:58.852859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'flavor' on Instance uuid f384cec4-20d3-4f6d-aeee-62ee2b5abe41 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:18:59.448125 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-686f537d-b89c-42f4-bbba-87809dff9732 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/action" status: 200 len: 32 microversion: 2.1 time: 0.689650 Jul 14 11:18:59.449475 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 90/211] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:18:58 2022] POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/action => generated 32 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:18:59.462509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:18:59.464720 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:18:59.489970 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:59.490548 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:59.504174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:18:59.506034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:18:59.734986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-68e9b437-8254-4518-86fd-64732aa8ff7e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: .version_select at 0x7f3412532040>, body: {"keypair": {"name": "tempest-keypair-823008519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK4soiWDZ+mHNXF5nh8e1iV7JXzEvRepN++FGGsKhF+pxuBKxKSsSzbAHExi/m1leiBg2fHYyWGVlCsysM7xh05Uc2+YpUBtt1GcOsWUdNX9YPlVK/N2T05qx5i41+yXA=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:18:59.814621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-68e9b437-8254-4518-86fd-64732aa8ff7e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:18:59.826009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-68e9b437-8254-4518-86fd-64732aa8ff7e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for user 4ebc96dc6b16411a9adb8e91793cda07 and project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:18:59.981475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-68e9b437-8254-4518-86fd-64732aa8ff7e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.581352 Jul 14 11:18:59.982955 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 122/212] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:18:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:00.031872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:00.044833 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bd97b378-4f40-4434-ba0d-f6978004720d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.589206 Jul 14 11:19:00.059473 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 91/213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:18:59 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:01.105070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:01.105747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:01.114565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:01.115640 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:01.117604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:01.118184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:01.418274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:01.428275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dec7c186-ab5f-4dfc-b6d8-c159bae6079d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.351163 Jul 14 11:19:01.429790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 123/214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:01 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:02.457378 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:02.459372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:02.469540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:02.470416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:02.472658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:02.473407 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:02.990831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:03.024216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2b485da3-8b6a-4fec-9eb4-1a4287cab3d2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.567426 Jul 14 11:19:03.025883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 92/215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:02 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:04.044471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:04.045766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:04.048860 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:04.085857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:04.093306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:04.094655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:04.098278 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:05.133054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:05.166779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-52248345-5a49-4d55-9458-df61f9111362 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 1.124732 Jul 14 11:19:05.168804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 124/216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:04 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:06.185417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:06.186289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:06.193674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:06.194146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:06.194940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:06.195411 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:06.592062 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:06.606209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-38480261-b64e-41b4-a785-914178d9ba9d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.425587 Jul 14 11:19:06.607257 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 93/217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:06 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:06.935823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1719058885", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33f5e5d7-403b-4ede-91af-86c50ab05f2c"}], "security_groups": [{"name": "tempest-securitygroup--635610099"}], "key_name": "tempest-keypair-823008519", "user_data": "}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:07.312479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] validate_networks() for [('33f5e5d7-403b-4ede-91af-86c50ab05f2c', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:07.664229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:07.665417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:07.682958 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:07.683525 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:07.684423 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:07.684957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:07.933771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:07.957290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b75dabaf-48a8-4099-b6b7-fb8a82bbf6ca tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.329538 Jul 14 11:19:07.958652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 94/218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:07 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:08.122920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:08.132361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:08.132361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:08.132361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:08.132361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:08.138416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:08.139593 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:08.140711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:08.141400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:08.171522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:08.208157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for user 4ebc96dc6b16411a9adb8e91793cda07 and project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:08.237336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:08.240900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:08.560936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3e504db2-8440-4416-bbc3-168ef98f1c45 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.638190 Jul 14 11:19:08.561629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 125/219] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:19:08.576276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fd61ba56-8413-42b5-a732-62dbfa2cf297 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:08.577106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fd61ba56-8413-42b5-a732-62dbfa2cf297 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:08.767717 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fd61ba56-8413-42b5-a732-62dbfa2cf297 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:08.779311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fd61ba56-8413-42b5-a732-62dbfa2cf297 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1237 microversion: 2.1 time: 0.207528 Jul 14 11:19:08.779954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 95/220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:08 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1237 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:08.980537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:08.985224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:09.007585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:09.008034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:09.009382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:09.013956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:09.351178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:09.364116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3e4ba34f-8020-4ebb-b662-8cb1e0f5912f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.392152 Jul 14 11:19:09.365162 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 126/221] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:08 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:09.802531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ec4a4ee3-8bbf-47e5-9345-7b68cd67321c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:09.804978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ec4a4ee3-8bbf-47e5-9345-7b68cd67321c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:09.947170 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ec4a4ee3-8bbf-47e5-9345-7b68cd67321c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:09.959707 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ec4a4ee3-8bbf-47e5-9345-7b68cd67321c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1237 microversion: 2.1 time: 0.165308 Jul 14 11:19:09.972147 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 96/222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:09 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1237 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:10.745915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:10.745915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:10.745915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:10.745915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:10.748820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:10.748820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:10.859912 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:10.871588 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a305df6e-9b31-48c3-bc81-06aa78bc71cb tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.491779 Jul 14 11:19:10.882846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 127/223] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:10 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:10.983972 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c5e375ee-003e-4bc5-87da-357f7d4e82c2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:10.985342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c5e375ee-003e-4bc5-87da-357f7d4e82c2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:11.065009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c5e375ee-003e-4bc5-87da-357f7d4e82c2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:11.080078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c5e375ee-003e-4bc5-87da-357f7d4e82c2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1237 microversion: 2.1 time: 0.100175 Jul 14 11:19:11.091598 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 97/224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:10 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:11.890033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:11.890905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:11.900444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:11.900889 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:11.908667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:11.909642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:12.099820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:12.100711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:12.124863 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:12.125423 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:12.126751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:12.127222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:12.261811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:12.277323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-87c3a16f-903c-414f-8734-c31623783398 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.391079 Jul 14 11:19:12.278712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 128/225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:11 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:12.284109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2019723239", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "networks": [{"uuid": "c6ac840a-5f03-40f9-b6b7-bdb362dbb235"}]}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:12.308952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:12.332434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3b69960c-cf3d-4d83-8947-08b44c24e97e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1241 microversion: 2.1 time: 0.237082 Jul 14 11:19:12.333446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 98/226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:12 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1241 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:13.298459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:13.312792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:13.337443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:13.338433 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:13.339925 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:13.340505 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:13.553794 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:13.563117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-66c9bd35-540f-4e21-a36d-33fe01c9640c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.271209 Jul 14 11:19:13.563826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 99/227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:13 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:13.569050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:13.569694 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:13.597289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:13.598677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:13.599819 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:13.600946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:13.692618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:13.702200 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7339108f-a8d9-455e-b080-49ee607916da tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1289 microversion: 2.1 time: 0.137260 Jul 14 11:19:13.702780 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 100/228] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:13 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:14.585477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:14.587671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:14.606852 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:14.606852 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:14.612270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:14.613482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:14.935438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:14.945954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-124adb70-a4db-4e7f-8fd1-64ee3fd330cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.364176 Jul 14 11:19:14.950561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 101/229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:14 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:14.961222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:14.962629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:14.990591 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:14.992658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:14.994953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:14.999655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:15.138155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:15.169432 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7f3b4637-9f6d-409a-8926-112c58b25714 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1307 microversion: 2.1 time: 0.216095 Jul 14 11:19:15.173121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 102/230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:14 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:15.973482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:15.975575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:15.995802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:15.996502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:15.997392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:16.001249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:16.347042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] validate_networks() for [('c6ac840a-5f03-40f9-b6b7-bdb362dbb235', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:16.411540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:16.435365 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-148070b9-b399-4e76-9815-80fd98eac303 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.466135 Jul 14 11:19:16.442074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 103/231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:15 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:16.453377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:16.455526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:16.468504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:16.471297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:16.472417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:16.474604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.031690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:17.038944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:17.062401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:17.063521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-181327fb-e920-4566-b4c9-66e1e4a0ccc4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.623813 Jul 14 11:19:17.064006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:17.065327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:17.067151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:17.067483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 104/232] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:16 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:17.068789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:17.094034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:17.095106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.097055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:17.098547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.127961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=61 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:17.164054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Getting quotas for project 76d33745da9045b989026dad3b5b7abb. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:17.171482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Getting quotas for user 162160bbb86e40c9bb957a213034e25f and project 76d33745da9045b989026dad3b5b7abb. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:17.207170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:17.209818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:17.434134 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-900d737c-8ef2-4c57-ad55-3a16fda57c67 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.153963 Jul 14 11:19:17.440448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 129/233] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 5161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:19:17.447106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-10180dde-24e5-4fad-a6dd-2960c2a9bc03 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:17.447874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-10180dde-24e5-4fad-a6dd-2960c2a9bc03 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:17.460337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:17.461713 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:17.495966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:17.495966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.495966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:17.495966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:17.640959 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-10180dde-24e5-4fad-a6dd-2960c2a9bc03 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:17.652226 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-10180dde-24e5-4fad-a6dd-2960c2a9bc03 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1214 microversion: 2.1 time: 0.210639 Jul 14 11:19:17.663902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 105/234] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:17 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:17.892448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:17.909437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1459c142-bc5b-4aec-a9d9-2efd4055cd73 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.454057 Jul 14 11:19:17.922962 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 130/235] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:17 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:18.083828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:18.084445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:18.087376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=50 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:18.093370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.093815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:18.094595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.095031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:18.256678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:18.266420 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9d489b4b-992c-4812-b324-2e52c11fb816 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.185943 Jul 14 11:19:18.267010 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 106/236] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:18 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:18.682912 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2afd9867-518a-4568-a8ca-4ea1f7423695 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:18.695576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2afd9867-518a-4568-a8ca-4ea1f7423695 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:18.753042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2afd9867-518a-4568-a8ca-4ea1f7423695 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:18.760898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2afd9867-518a-4568-a8ca-4ea1f7423695 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1214 microversion: 2.1 time: 0.083115 Jul 14 11:19:18.761470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 131/237] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:18 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:18.928401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:18.928803 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:18.935679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.936400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:18.937264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.937703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:18.981293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-11ecf8a4-801b-45fa-b973-6b02f9604bd8 req-0536cace-fd35-4397-ac82-5cb4dd1902e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3c6670-5e21-4f8e-93c1-66a524a5510d", "tag": "9f0c7c24-b3e4-438d-bf41-131c88721ff4"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:18.992898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-11ecf8a4-801b-45fa-b973-6b02f9604bd8 req-0536cace-fd35-4397-ac82-5cb4dd1902e6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:18.993550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-11ecf8a4-801b-45fa-b973-6b02f9604bd8 req-0536cace-fd35-4397-ac82-5cb4dd1902e6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:19.010434 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-11ecf8a4-801b-45fa-b973-6b02f9604bd8 req-0536cace-fd35-4397-ac82-5cb4dd1902e6 service nova] Creating event network-changed:9f0c7c24-b3e4-438d-bf41-131c88721ff4 for instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d on hv-cinder-82282 Jul 14 11:19:19.016341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-11ecf8a4-801b-45fa-b973-6b02f9604bd8 req-0536cace-fd35-4397-ac82-5cb4dd1902e6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041503 Jul 14 11:19:19.017412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 132/238] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:19.173623 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:19.186186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f6cd79d3-473e-42bb-866f-a88bf7c8e3d4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.261836 Jul 14 11:19:19.186853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 107/239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:18 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:19.291729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:19.292923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:19.305085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:19.305773 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:19.307691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:19.308171 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:19.502283 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:19.513766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1c55b16f-fb8c-4936-8dce-9605fa4911f8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.231694 Jul 14 11:19:19.514554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 133/240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:19 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:19.792505 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6cda042d-19f3-4ebd-b12f-32201004b73a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:19.802867 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6cda042d-19f3-4ebd-b12f-32201004b73a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:19.895021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6cda042d-19f3-4ebd-b12f-32201004b73a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:19.907298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6cda042d-19f3-4ebd-b12f-32201004b73a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1214 microversion: 2.1 time: 0.132322 Jul 14 11:19:19.908707 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 108/241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:19 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:20.208941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:20.209973 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:20.217224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.217678 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:20.218474 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.218910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:20.427438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:20.438742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b8e0fadd-b280-4a76-8830-b53e2694f85b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.236711 Jul 14 11:19:20.439685 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 134/242] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:20 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:20.534689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:20.538661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:20.556593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.557050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:20.557855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.558290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:20.890629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:20.902129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-43e7eb20-c958-4145-9caa-45ce5516a9c1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.371868 Jul 14 11:19:20.912004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 109/243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:20 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:20.933290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:20.933968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:20.946789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.949982 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:20.951638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:20.951873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.035397 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:21.050629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b6245072-d25c-4cb5-9987-88e5582bc9bc tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1218 microversion: 2.1 time: 0.128226 Jul 14 11:19:21.052425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 135/244] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:20 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:21.469530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:21.471280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:21.483934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:21.485134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.486851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:21.487838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.925993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:21.926758 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:21.940087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:21.940326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:21.941065 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:21.941503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:22.023494 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:22.035148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0cd322fa-aa5b-4b10-a9ee-3ad51ea95cce tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.572946 Jul 14 11:19:22.036176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 110/245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:21 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:22.080713 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:22.082063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:22.099458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:22.106534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:22.106534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:22.106534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:22.331602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:22.342623 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a9bf7236-d14c-4b7c-b013-23358f7edda6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1210 microversion: 2.1 time: 0.270851 Jul 14 11:19:22.354454 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 111/246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:22 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1210 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:22.362738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:22.377485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d6ea06fd-2b8e-4c28-a7a9-373bef7c4ba7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.454998 Jul 14 11:19:22.380479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 136/247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:21 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:23.057952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:23.088921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:23.088921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.088921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.088921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.090319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.371073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:23.372291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:23.380007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.380633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.381529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.382749 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.393402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:23.405349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-45ec435d-d8c6-41a0-84ab-004fa3bbc9ae tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1502 microversion: 2.1 time: 0.355160 Jul 14 11:19:23.406460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 112/248] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:23 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1502 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:23.412709 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:23.413690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:23.422562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.423582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.425113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.426095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.486202 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:23.495244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ac9587d2-863f-45e9-9a7a-07e50b92772c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.134008 Jul 14 11:19:23.495872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 137/249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:23 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:23.500830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae870518-e175-4b10-b835-4a9952915aa4"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:23.501928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:23.508888 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.509379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.510649 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.511093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.544057 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] HTTP exception thrown: Cannot 'attach_volume' instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 while it is in vm_state rescued Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Request method failure captured: Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/os-volume_attachments HTTP/1.1 Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 74 Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s4s8eZc0yEZA9xVxWy755FnwSggKF-HEBU84sm1M6JV9jHFOV4lg2ORyRU_7Y9BQtsfqnMAudUP2ADsfzx18NKuuxncTH6tMPlf8sqB5Sk_7a3IhAYCkGzEuQGXNOZ7xuY-_VTtM8oWs_Lx7t_tW8qsGf5EBfBGZdPYLiBNHTScHY Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:19:23.546395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_08cc50e4caea44e2a2bb1413a35e3b6d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: e3e8aa5fc932453e95080fa836dfac0c Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {"volumeAttachment": {"volumeId": "ae870518-e175-4b10-b835-4a9952915aa4"}} Jul 14 11:19:23.548409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Cannot 'attach_volume' instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 while it is in vm_state rescued Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'server_id': 'f384cec4-20d3-4f6d-aeee-62ee2b5abe41', 'body': {'volumeAttachment': {'volumeId': 'ae870518-e175-4b10-b835-4a9952915aa4'}}} Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:19:23.549621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 while it is in vm_state rescued Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:19:23.551433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 while it is in vm_state rescued Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Returning 409 to user: Cannot 'attach_volume' instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 while it is in vm_state rescued {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-15dc76e8-6ad4-46d4-b9c8-12421230864c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051167 Jul 14 11:19:23.552499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 138/250] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:19:23 2022] POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:19:23.566922 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:23.567933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:23.582067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.582859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.584304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:23.585088 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:23.603902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:23.614550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c169dad6-14f7-4b87-a4c3-2eca8176ab30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.206509 Jul 14 11:19:23.615769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 113/251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:23 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:24.518014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:24.518667 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:24.525731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.526175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.526945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.527440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.567633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ca06c31c-3ce9-496d-9a06-1a816e9dadc3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/action" status: 202 len: 0 microversion: 2.1 time: 1.008642 Jul 14 11:19:24.568410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 139/252] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:19:23 2022] POST /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41/action => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:19:24.578054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:24.578739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:24.590625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.591076 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.591995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.592430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.603455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:24.612307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bf544578-6866-415a-8d3a-06a8bef095b2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.098080 Jul 14 11:19:24.613236 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 114/253] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:24 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:24.637186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:24.637740 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:24.644636 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.645096 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.645999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:24.646357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:24.742343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:24.750072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b11956b3-fa3e-4813-9881-d57626c3e750 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.176101 Jul 14 11:19:24.750642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 140/254] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:24 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:24.807843 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:24.817689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9f27a819-0970-40f3-94dc-b2530bde46ca tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.185468 Jul 14 11:19:24.818314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 115/255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:24 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:25.326665 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-80d66df6-f2e2-4cad-acb6-0f719b0ca32b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Action: 'create', calling method: .version_select at 0x7f34124ec040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1763624318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiQp8jeUearz/XDYwQ5c6btHunATGoX4hocaR5I25YRn1aDRK1w7fkVy7tz0/PSj6tJDqkETxa8FWciLpoSO/v1U90oGvqFOPswp/+WAVjNSa8hNwi8heiGjqmVMndnmA=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:25.338972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=19 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:25.342442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-80d66df6-f2e2-4cad-acb6-0f719b0ca32b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Getting quotas for project 20b87d0f8d1c4ab8a9218ec96872750f. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:25.346404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-80d66df6-f2e2-4cad-acb6-0f719b0ca32b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Getting quotas for user 41bc56e0e3d0451482572959451ae043 and project 20b87d0f8d1c4ab8a9218ec96872750f. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:25.549416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-80d66df6-f2e2-4cad-acb6-0f719b0ca32b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.226549 Jul 14 11:19:25.550006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 141/256] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:19:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:19:25.606693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-547838347", "imageRef": "917f032a-df57-4104-adea-dbeae7054ed1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1763624318", "networks": [{"uuid": "8572ca9e-1c97-4619-9493-8131a0ea9971"}]}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:25.638664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:25.639460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:25.646781 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.647278 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.648908 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.649354 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.669331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] validate_networks() for [('8572ca9e-1c97-4619-9493-8131a0ea9971', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:25.719516 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:25.728871 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-326b1c56-f515-47b7-bc85-1c4f506833c2 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.094928 Jul 14 11:19:25.730140 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 142/257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:25 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:25.770457 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:25.771227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:25.778148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.778685 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.785110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.785110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.931153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:25.939298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b7ce32f1-ae9f-4b8d-a313-f761a1c7f7dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.173813 Jul 14 11:19:25.939928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 143/258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:25 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:25.945823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:25.946561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:25.953833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.954320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:25.955233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:25.955760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.106009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:26.106009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:26.107085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:26.108148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:26.108765 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:26.126617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:26.129076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.129529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.133104 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.133104 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.137528 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3fbd89c3-8eb3-4748-9844-df17a47117d1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.196495 Jul 14 11:19:26.138119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 144/259] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:25 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:26.150623 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Getting quotas for project 20b87d0f8d1c4ab8a9218ec96872750f. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:26.155765 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Getting quotas for user 41bc56e0e3d0451482572959451ae043 and project 20b87d0f8d1c4ab8a9218ec96872750f. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:26.169574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:26.174315 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917f032a-df57-4104-adea-dbeae7054ed1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:26.556367 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7dd45c30-ef25-41f3-8963-0e20a535b5ee tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954631 Jul 14 11:19:26.557055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 116/260] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:19:26.567168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4da2a326-efe7-4019-b7c4-52c50e4dcbab tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:26.568081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4da2a326-efe7-4019-b7c4-52c50e4dcbab tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:26.624711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4da2a326-efe7-4019-b7c4-52c50e4dcbab tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:26.632318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4da2a326-efe7-4019-b7c4-52c50e4dcbab tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1258 microversion: 2.1 time: 0.068950 Jul 14 11:19:26.633450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 145/261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:26 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:26.747550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:26.748164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:26.758458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.758916 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.759751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.760190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.830250 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:26.838819 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ea89591c-8f27-462e-a119-22563cfe4908 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.095852 Jul 14 11:19:26.839434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 117/262] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:26 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:26.957055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:26.957670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:26.964789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.965231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:26.965992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:26.966421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.107587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:27.115020 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4698bbf3-fb61-4b4c-a7d7-ac9869a7aafc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.161984 Jul 14 11:19:27.115672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 146/263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:26 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:27.156426 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:27.157042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:27.163334 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.163869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.165224 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.165899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.299022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:27.306741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6da01d7f-035c-4532-bee0-b55e4654a024 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.154037 Jul 14 11:19:27.314983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 118/264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:27 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:27.650734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e626c40-e662-4c93-b127-414b6fc1b913 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:27.651390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2e626c40-e662-4c93-b127-414b6fc1b913 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:27.653178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=4 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:27.707037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2e626c40-e662-4c93-b127-414b6fc1b913 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:27.714138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2e626c40-e662-4c93-b127-414b6fc1b913 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1258 microversion: 2.1 time: 0.068198 Jul 14 11:19:27.714695 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 147/265] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:27 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:27.855189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:27.855799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:27.862567 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.863021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.863926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:27.864456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:27.938403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:27.947874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cd704bc4-24fd-4bf3-b4a9-a289b3b05a30 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.096220 Jul 14 11:19:27.947874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 119/266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:27 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:28.134047 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:28.134780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:28.141331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.141771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.142546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.142977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.297763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:28.308502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d515963a-7609-4c33-963b-1331132776c4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.177461 Jul 14 11:19:28.308502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 148/267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:28 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:28.328225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:28.329368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:28.340503 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.341313 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.342778 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.343645 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.568019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:28.575710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d1881f36-f88a-4137-a175-4ea79eab1cfc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.255137 Jul 14 11:19:28.576251 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 120/268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:28 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:28.731889 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6b0dc746-a626-4666-8b95-a0338edc678c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:28.732607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6b0dc746-a626-4666-8b95-a0338edc678c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:28.791632 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6b0dc746-a626-4666-8b95-a0338edc678c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:28.799152 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6b0dc746-a626-4666-8b95-a0338edc678c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1258 microversion: 2.1 time: 0.070997 Jul 14 11:19:28.799813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 149/269] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:28 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:28.965241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:28.965786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:28.977109 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.977558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:28.978332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:28.978771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.056849 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:29.064734 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-de03e968-5766-46c9-b8b9-bb8093b945f6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.104563 Jul 14 11:19:29.065295 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 121/270] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:28 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:29.325374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:29.325975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:29.328176 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:29.333372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.338368 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.338368 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.338368 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.485999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:29.495735 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-26ab95df-6e97-4768-8c4e-3e1380104ca8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.173358 Jul 14 11:19:29.495735 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 150/271] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:29 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:29.593601 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:29.594218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:29.601056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.601628 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.602706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.603359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.739404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:29.747896 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e1f8de8b-5af0-46e3-83e3-e7aa14dbd426 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.157996 Jul 14 11:19:29.748400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 122/272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:29 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:29.820423 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:29.821505 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:29.832101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.832852 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.834195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:29.835015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:29.857780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:29.907733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:29.916206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-acfb327b-0de1-47c1-a349-5031b0c5a3c2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1262 microversion: 2.1 time: 0.102582 Jul 14 11:19:29.916780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 151/273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:29 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:30.082804 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:30.083441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:30.091523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.091967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.092747 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.093174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.167227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:30.174624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c3f67ec2-6d58-4a1b-af74-d60cbedeecce tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1266 microversion: 2.1 time: 0.095616 Jul 14 11:19:30.175209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 123/274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:30 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:30.513470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:30.514321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:30.521867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.523269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.524619 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.525308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.688137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:30.697289 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-702dfeff-6639-4d31-bede-02460bf74d11 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.187930 Jul 14 11:19:30.698559 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 152/275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:30 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:30.769531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:30.771566 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:30.777450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.777947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.779231 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.779669 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.783999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:30.935530 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:30.936481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:30.943672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.945646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:30.946588 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:30.947088 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.011254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:31.015064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:31.020115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2c85481e-663e-42a2-9183-381fcaae0e62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1254 microversion: 2.1 time: 0.090270 Jul 14 11:19:31.020788 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 153/276] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:30 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1254 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:31.031172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-12a1ed03-6697-42b9-838d-b75a34dd807c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.259364 Jul 14 11:19:31.031172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 124/277] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:30 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:31.197404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:31.199106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:31.206531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:31.207220 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.208479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:31.226844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.286238 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:31.297066 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a752c7ba-faf7-46fd-bfbc-d86d4a4e4504 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1284 microversion: 2.1 time: 0.106321 Jul 14 11:19:31.298024 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 125/278] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:31 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:31.717569 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:31.718785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:31.726887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:31.733534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.733534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:31.733534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:31.882104 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:31.889613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b52d1b4d-f398-4852-8bd4-c1389b4b15b4 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.177004 Jul 14 11:19:31.890176 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 154/279] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:31 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:32.040949 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:32.041528 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:32.041745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:32.042143 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:32.048454 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.048789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.049057 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.049183 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.054229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.054450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.054604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.054762 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.134143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:32.144738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-30439340-ba17-4f3c-8233-520c7b9c1219 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1310 microversion: 2.1 time: 0.108785 Jul 14 11:19:32.145423 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 126/280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:32 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:32.199773 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:32.206972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-57674e2b-2f2d-4850-b32c-dc8cb770a894 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.170062 Jul 14 11:19:32.207543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 155/281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:32 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:32.322611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:32.323478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:32.330949 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.342974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.342974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.342974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.476166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:32.484721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1b463b70-740c-4b47-9de1-ab87237bef83 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.167503 Jul 14 11:19:32.485338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 127/282] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:32 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:32.908854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:32.909466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:32.916428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.916879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:32.917673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:32.918105 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.051874 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:33.060739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ab0e68cf-58c7-4c7d-a914-4c7166bb0950 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.155552 Jul 14 11:19:33.060739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 156/283] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:32 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:33.164718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:33.165252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:33.171529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.171980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.172752 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.173240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.225717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:33.229762 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:33.236460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.236911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.238484 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.239048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.246092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:33.258460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-be1486a8-7761-4460-bb73-8eda0409f799 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1310 microversion: 2.1 time: 0.099010 Jul 14 11:19:33.272836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 128/284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:33 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1310 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:33.388942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:33.396409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bfb454d2-80a1-40e9-8484-ec0e4ec336e4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.175221 Jul 14 11:19:33.397607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 157/285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:33 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:33.504084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:33.504855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:33.512350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.516679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.516679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:33.516679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:33.663019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:33.694441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-11f9ae13-00aa-43b8-a3d5-9ca6a60522ba tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.173825 Jul 14 11:19:33.694441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 129/286] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:33 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:34.077831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:34.078450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:34.085866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.086582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.087376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.087862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.220082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:34.228146 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-981ecd5d-d800-42ef-b8bd-ce9cc74f6b7b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.154498 Jul 14 11:19:34.228708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 158/287] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:34 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:34.286327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:34.288166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:34.297286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.298015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.299337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.300046 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.371865 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:34.380123 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0ba749eb-227f-492b-a5f4-8d45f3cf7d39 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1310 microversion: 2.1 time: 0.099973 Jul 14 11:19:34.380693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 130/288] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:34 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:34.415451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:34.435681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:34.435681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.435681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.435681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.436098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.559309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:34.569275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bdd007d2-92e3-462b-b09c-3edeab0c5e98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.158919 Jul 14 11:19:34.570075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 159/289] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:34 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:34.630103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-c4d3819d-4212-4e0f-923a-6784707dea9a req-9c189e59-b3b6-492d-990c-e8c7393fda69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3c6670-5e21-4f8e-93c1-66a524a5510d", "name": "network-vif-plugged", "status": "completed", "tag": "9f0c7c24-b3e4-438d-bf41-131c88721ff4"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:34.641533 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c4d3819d-4212-4e0f-923a-6784707dea9a req-9c189e59-b3b6-492d-990c-e8c7393fda69 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.641978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c4d3819d-4212-4e0f-923a-6784707dea9a req-9c189e59-b3b6-492d-990c-e8c7393fda69 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.653954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-c4d3819d-4212-4e0f-923a-6784707dea9a req-9c189e59-b3b6-492d-990c-e8c7393fda69 service nova] Creating event network-vif-plugged:9f0c7c24-b3e4-438d-bf41-131c88721ff4 for instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d on hv-cinder-82282 Jul 14 11:19:34.659207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-c4d3819d-4212-4e0f-923a-6784707dea9a req-9c189e59-b3b6-492d-990c-e8c7393fda69 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033816 Jul 14 11:19:34.659881 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 131/290] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:34.692109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:34.692858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:34.699108 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.699661 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.700507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:34.701014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:34.864660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:34.873532 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-66527b16-f8a9-4610-8d38-f7e0e766576a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.185186 Jul 14 11:19:34.874130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 160/291] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:34 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:35.247311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:35.248143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:35.254354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.254801 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.255596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.256666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.398159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:35.398834 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:35.400129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:35.408459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b1ba9817-199d-4132-9427-d97b74aa0239 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.165219 Jul 14 11:19:35.408795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.409490 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.409696 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 132/292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:35 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:35.410879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.411926 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.493969 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:35.502401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9b898f78-c146-4403-b572-d89ec9f16e15 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1310 microversion: 2.1 time: 0.108720 Jul 14 11:19:35.503087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 161/293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:35 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:35.599511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:35.601141 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:35.616016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.616016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.616016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.616016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.863358 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:35.875441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e99068ee-57b4-4b99-8d43-403bf8ff8591 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.280271 Jul 14 11:19:35.876028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 133/294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:35 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:35.900154 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:35.901247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:35.909212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.909905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:35.919016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:35.919016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.063205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:36.072166 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a79cad82-698b-4265-81e6-789eaccd39e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.180653 Jul 14 11:19:36.072929 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 162/295] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:35 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:36.441619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:36.442633 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:36.445758 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:36.446460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=16 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:36.458549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.461677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.462777 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.463252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.520228 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:36.520893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:36.527478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.527937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.528718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.529182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.611537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:36.623756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-37d5860b-1e81-481e-8a03-6ecfa1d3be77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1310 microversion: 2.1 time: 0.107250 Jul 14 11:19:36.637151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 163/296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:36 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1310 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:36.664080 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:36.673803 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d6f9eebc-4518-4b0d-9a67-42b31f15b2ec tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1510 microversion: 2.1 time: 0.239668 Jul 14 11:19:36.675157 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 134/297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:36 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:36.870795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-1ec1dce1-64d3-483b-9a8f-d97bea6fe1f0 req-ea6ab391-5336-4a74-808c-8eb91727af7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eaab181-9ee3-430f-b33c-181879d97df0", "tag": "3d66bce9-9b3e-43f1-96c2-c33922393d16"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:36.884095 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-1ec1dce1-64d3-483b-9a8f-d97bea6fe1f0 req-ea6ab391-5336-4a74-808c-8eb91727af7e service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.884547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-1ec1dce1-64d3-483b-9a8f-d97bea6fe1f0 req-ea6ab391-5336-4a74-808c-8eb91727af7e service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.897001 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:36.897675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:36.908053 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.911212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.913596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:36.914706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:36.919615 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-1ec1dce1-64d3-483b-9a8f-d97bea6fe1f0 req-ea6ab391-5336-4a74-808c-8eb91727af7e service nova] Creating event network-changed:3d66bce9-9b3e-43f1-96c2-c33922393d16 for instance 8eaab181-9ee3-430f-b33c-181879d97df0 on hv-cinder-82282 Jul 14 11:19:36.926717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-1ec1dce1-64d3-483b-9a8f-d97bea6fe1f0 req-ea6ab391-5336-4a74-808c-8eb91727af7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061299 Jul 14 11:19:36.927609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 164/298] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:37.092413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:37.092887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:37.094699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:37.100872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:37.101601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:37.102522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:37.102966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:37.103395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6be699ab-5dbc-4ae6-8d2f-22ffb452259b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.210792 Jul 14 11:19:37.113216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 135/299] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:36 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:37.263032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:37.271210 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c62f2898-b697-4433-b990-be838977e1b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.184143 Jul 14 11:19:37.272624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 165/300] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:37 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:37.643276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:37.643897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:37.651936 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:37.652579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:37.653220 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:37.653652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:37.693561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:37.694903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:37.701699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:37.702293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:37.703330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:37.703873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:37.721178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:37.731457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7954d422-b300-4fda-9622-86b33c2081e3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1328 microversion: 2.1 time: 0.091834 Jul 14 11:19:37.732908 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 136/301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:37 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:37.964992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:37.973882 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-37412fa6-b1eb-4484-bede-c4fe1ab5f7da tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1516 microversion: 2.1 time: 0.284339 Jul 14 11:19:37.974607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 166/302] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:37 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1516 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:38.122184 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:38.122824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:38.130592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.132331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.133397 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.133940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.285746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:38.290787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:38.291438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:38.295370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4e07e5b7-ca91-4317-b4e6-84602c2650a7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.177413 Jul 14 11:19:38.296374 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 137/303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:38 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:38.298752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.299236 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.309849 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.309849 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.491564 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:38.499497 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-21c9185e-733e-4c09-97cf-bb2b743c11f7 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.213932 Jul 14 11:19:38.504454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 167/304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:38 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:38.760885 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:38.764750 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:38.781114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.781620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:38.782446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:38.782892 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.326362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=9 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:39.332226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:39.333432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:39.343888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:39.344687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.345204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.346502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.347274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.369034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ab8d3b6a-f191-43ad-9181-635088b4d6b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.619242 Jul 14 11:19:39.371897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 138/305] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:38 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:39.522946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:39.531966 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:39.553126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.553126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.559952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:39.560652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:39.673933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:39.676812 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:39.688890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d281382b-2938-4865-b18f-90eea23f93be tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1362 microversion: 2.1 time: 0.362263 Jul 14 11:19:39.690961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 168/306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:39 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:39.858684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:39.870646 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2cdfa1bb-b4c6-4001-a3a6-14de9b3551e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.355587 Jul 14 11:19:39.872078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 139/307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:39 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:40.214601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-e8c057f0-a0b7-4393-b69d-65732391ef83 req-b76ee513-95be-4494-93c7-dfa399feae09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:40.228778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e8c057f0-a0b7-4393-b69d-65732391ef83 req-b76ee513-95be-4494-93c7-dfa399feae09 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.230193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e8c057f0-a0b7-4393-b69d-65732391ef83 req-b76ee513-95be-4494-93c7-dfa399feae09 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.244891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-e8c057f0-a0b7-4393-b69d-65732391ef83 req-b76ee513-95be-4494-93c7-dfa399feae09 service nova] Creating event network-changed:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:19:40.257333 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-e8c057f0-a0b7-4393-b69d-65732391ef83 req-b76ee513-95be-4494-93c7-dfa399feae09 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042226 Jul 14 11:19:40.264317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 169/308] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:19:40.399549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:40.401824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:40.425173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.426746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.429342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.444366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.704388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:40.714828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8106ef79-6c50-49bb-b6ff-c9c116437529 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.322867 Jul 14 11:19:40.723790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:40.726686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:40.728895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 140/309] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:40 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:40.753402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.767410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.768831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.769568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.891299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:40.892205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:40.914785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.915631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.917076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:40.917926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:40.941289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:40.982773 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:40.995990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0969e686-c7b0-45cb-8e61-75951d37fe5e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1548 microversion: 2.1 time: 0.281687 Jul 14 11:19:40.996755 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 170/310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:40 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1548 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:41.033354 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:41.033839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:41.041600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.042053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.042827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.043318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.227591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fb19e54b-2051-4a2d-99dd-f3a592125c33 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198341 Jul 14 11:19:41.234297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 171/311] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:19:41 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:41.261016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:41.280945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-056229b5-94cb-46b3-a44c-da5f2655a275 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.395754 Jul 14 11:19:41.282669 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 141/312] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:40 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:41.653477 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-27561c29-8afe-4f9f-b8f5-ea2dacd27864 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'create', calling method: .version_select at 0x7f3412532280>, body: {"keypair": {"name": "tempest-keypair-1442404034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4q3hrUsZGMVSoB1qFKT7ovXNmoH2/3Kv5YDAHROCz2j0SlmKkKAEVuFCbpftsp7vnIT3oNI2ZMlny0tMeA53kQGHljQPZ3zhLsIVJEjIWS+6Le/aqOeDieYiZ6scipxw=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:41.686475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-27561c29-8afe-4f9f-b8f5-ea2dacd27864 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:41.693999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-27561c29-8afe-4f9f-b8f5-ea2dacd27864 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for user e3e8aa5fc932453e95080fa836dfac0c and project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:41.749028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:41.751415 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:41.768982 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.769635 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.772191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:41.772878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:41.889175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-27561c29-8afe-4f9f-b8f5-ea2dacd27864 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239199 Jul 14 11:19:41.890856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 172/313] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:19:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:19:42.111722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:42.128685 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2da6ee6b-c288-48b8-b294-35a05bc1ae59 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.385991 Jul 14 11:19:42.137772 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 142/314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:41 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:42.303173 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:42.304247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:42.315198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:42.316331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:42.318545 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:42.319833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:42.905909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:42.916422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-75d5b0ba-8ecc-4be6-8d09-da3c2a0fd81e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.620279 Jul 14 11:19:42.917001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 173/315] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:42 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:43.154356 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:43.155627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:43.166711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:43.167483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:43.168451 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:43.169048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:43.441213 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:43.465440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c3911794-c9dc-4976-b48f-a61eeb2c79b1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.315055 Jul 14 11:19:43.469775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 143/316] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:43 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:43.834619 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-7253058b-667e-4fb4-9ded-30b48a831e34 req-c8572eae-9ea3-4724-b20b-dc0d3cd669ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3c6670-5e21-4f8e-93c1-66a524a5510d", "tag": "9f0c7c24-b3e4-438d-bf41-131c88721ff4"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:43.851685 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-7253058b-667e-4fb4-9ded-30b48a831e34 req-c8572eae-9ea3-4724-b20b-dc0d3cd669ea service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:43.852568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-7253058b-667e-4fb4-9ded-30b48a831e34 req-c8572eae-9ea3-4724-b20b-dc0d3cd669ea service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:43.875529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-7253058b-667e-4fb4-9ded-30b48a831e34 req-c8572eae-9ea3-4724-b20b-dc0d3cd669ea service nova] Creating event network-changed:9f0c7c24-b3e4-438d-bf41-131c88721ff4 for instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d on hv-cinder-82282 Jul 14 11:19:43.886972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-7253058b-667e-4fb4-9ded-30b48a831e34 req-c8572eae-9ea3-4724-b20b-dc0d3cd669ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055561 Jul 14 11:19:43.888839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 174/317] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:19:43.946914 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:43.957448 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:43.965222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:43.965672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:43.966486 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:43.966880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.129028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:44.136834 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cb12aa7f-2d77-4af6-820b-827bec7641e8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.194815 Jul 14 11:19:44.137508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 144/318] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:43 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:44.501571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:44.502748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:44.509496 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.509946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.510833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:44.511312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:44.676150 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:44.685373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e158b061-bc3f-4da9-9034-c60fbbc22752 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.187990 Jul 14 11:19:44.685968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 175/319] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:44 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:45.158888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:45.160221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:45.172496 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:45.173282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:45.175027 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:45.175824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:45.429891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:45.437387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-76e4f56b-33a2-4450-b833-fdc4b7752499 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.286029 Jul 14 11:19:45.438177 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 145/320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:45 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:45.708776 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:45.725771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:45.725771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:45.725771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:45.725771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:45.726750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:45.866385 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:45.874605 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9cdfb32b-8f91-4957-a720-fdccabf64f86 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.170417 Jul 14 11:19:45.875146 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 176/321] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:45 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:46.236953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1279301406", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e30da614-ae13-4a5b-8eaf-d8446472405a"}], "security_groups": [{"name": "tempest-securitygroup--1279198477"}], "key_name": "tempest-keypair-1442404034", "user_data": "}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:19:46.375862 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] validate_networks() for [('e30da614-ae13-4a5b-8eaf-d8446472405a', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:19:46.468729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:46.469513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:46.476934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.477547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:46.479337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.480002 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:46.652700 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:46.754635 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:46.789380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f6d9e08c-9f69-4f83-b850-19a60472f02a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.329212 Jul 14 11:19:46.790406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 177/322] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:46 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:46.901092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:46.902503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:46.914963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.915843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:46.917625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:46.919024 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.052962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:19:47.052962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:19:47.052962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:19:47.052962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:19:47.052962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:19:47.071177 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.072738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.074396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.075477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.104611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:19:47.110081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Getting quotas for user e3e8aa5fc932453e95080fa836dfac0c and project 08cc50e4caea44e2a2bb1413a35e3b6d. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:19:47.123665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:19:47.125962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:19:47.149893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:47.159726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5836253e-765f-453a-bbca-330662441ec8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.269851 Jul 14 11:19:47.164745 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 178/323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:46 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:47.287092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-28f69254-bf08-4223-85f8-cbf3849a0640 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.054402 Jul 14 11:19:47.287674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 146/324] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:19:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:19:47.297495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cc55a3c6-df4d-4c7d-9f92-f9634e6248b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:47.298558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cc55a3c6-df4d-4c7d-9f92-f9634e6248b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:47.360974 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cc55a3c6-df4d-4c7d-9f92-f9634e6248b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:47.369386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cc55a3c6-df4d-4c7d-9f92-f9634e6248b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1246 microversion: 2.1 time: 0.075462 Jul 14 11:19:47.370221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 179/325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:47 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:47.808269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:47.808820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:47.815270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.815730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.816546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:47.816987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:47.956553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:47.967592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4d9eccda-8114-4c5d-ac34-83c19f736f91 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.163267 Jul 14 11:19:47.968617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 147/326] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:47 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:48.186982 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:48.188005 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:48.197219 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:48.197688 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:48.198441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:48.198941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:48.400501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:48.401557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:48.419330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:48.420265 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:48.421969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:48.422749 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:48.424518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:48.435379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-90fb1463-5963-4b73-a0f8-af32a2249c7a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.252374 Jul 14 11:19:48.445963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 180/327] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:48 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:48.538638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:48.547777 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dde6d5e4-23f5-4994-bf4d-3113929293c1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.164174 Jul 14 11:19:48.548477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 148/328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:48 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:48.993813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:49.022115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:49.022115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.022115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.022115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.022541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.146925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:49.154335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ce498cb8-9eca-4e53-8c8c-a0d0b3775902 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.164894 Jul 14 11:19:49.154895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 181/329] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:48 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:49.455208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:49.455822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:49.462874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.463361 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.464139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.464577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.565813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:49.571096 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:49.573431 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.573886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.574663 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:49.575147 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:49.613251 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:49.622671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-73bd8b9f-d243-49f9-80ca-a5e38cbe58ac tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.171499 Jul 14 11:19:49.623369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 149/330] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:49 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:49.644421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:49.658234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d6b3164b-dc85-4f71-bd70-85480941a3dc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.095829 Jul 14 11:19:49.659178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 182/331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:49 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:50.172205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:50.172811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:50.180338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.180788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.181559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.181993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.322229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:50.329982 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-38dea115-b45f-445c-96d6-14b2fdaf2404 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.161804 Jul 14 11:19:50.330541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 150/332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:50 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:50.640963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:50.642398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:50.655857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.655857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.655857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.655857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.688060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:50.689887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:50.701535 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.702617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.704355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:50.705365 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:50.803018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:50.813749 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-757eb8b5-e6e9-4382-b628-879487ac5ac6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.132439 Jul 14 11:19:50.814762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 151/333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:50 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:50.834376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:50.844323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6a97f1c4-1a11-4dac-ba4c-471b8febaf2c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.207136 Jul 14 11:19:50.845163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 183/334] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:50 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:51.347745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:51.348556 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:51.354734 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:51.355220 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.356029 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:51.356470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.525137 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:51.537793 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2a815658-0e7c-4d38-8221-f37c2241b869 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.193743 Jul 14 11:19:51.538855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 152/335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:51 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:51.834241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:51.837808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:51.843516 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:51.844038 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.844827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:51.845263 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.864995 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:51.867101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:51.875871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:51.876650 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.877629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:51.878068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:51.920633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:51.929902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2389007e-e368-4d90-8708-d12302552a21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.099804 Jul 14 11:19:51.931016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 184/336] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:51 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:52.061519 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:52.070938 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7b554802-3eff-4f99-9942-ba8346160b00 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.211772 Jul 14 11:19:52.071577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 153/337] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:51 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:52.557475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:52.558102 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:52.565178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:52.565626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:52.566406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:52.567476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:52.745823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:52.773686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-65981d32-dfb4-401b-adec-231b852eac73 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.213315 Jul 14 11:19:52.774390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 185/338] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:52 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:52.946934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:52.948114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:52.959453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:52.960454 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:52.961783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:52.962489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.050338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:53.059169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-294a6749-fc2a-40a8-be78-ab1ab6337d9a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.116208 Jul 14 11:19:53.068579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 154/339] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:52 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:53.093999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:53.104230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:53.104230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:53.104230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.104230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:53.104814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.289744 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:53.297920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-01612eff-efa8-4c0c-b8e9-a5d7440eba0c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.208025 Jul 14 11:19:53.298499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 186/340] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:53 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:53.800741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:53.802407 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:53.810833 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:53.811280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.812392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:53.813036 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:53.995478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:54.007624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-84bd3b4f-4e28-46b9-9cf3-bdc4471ce6a3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.212756 Jul 14 11:19:54.008298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 155/341] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:53 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:54.080676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:54.082026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:54.091383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.091841 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.092656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.093100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.190424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:54.201983 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-68ce7ae5-0ada-4573-aa91-b6a62c2381ef tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.128299 Jul 14 11:19:54.202570 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 187/342] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:54 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:54.317418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:54.318059 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:54.327310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.327811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.328626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:54.329067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:54.491990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:54.502242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1904315a-9c74-49eb-8ab9-e1a6339efbda tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.189270 Jul 14 11:19:54.503019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 156/343] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:54 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:55.026649 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:55.027290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:55.036320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.036811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.037689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.038121 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.221694 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:55.222284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:55.224593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:55.231623 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.232498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.233606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.234227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.240524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-66620120-33d5-4f41-aa5d-13968fd746ae tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.216497 Jul 14 11:19:55.241994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 188/344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:55 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:55.321297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:55.330403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-da6d57cf-cb81-4e08-a768-665831a8fdc0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.113155 Jul 14 11:19:55.330963 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 157/345] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:55 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:55.535077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:55.535989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:55.544161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.544673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.545548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:55.546350 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:55.549611 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:55.700413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:55.707994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e6ff532b-4438-43ea-8e1e-c395db19bfaa tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.190590 Jul 14 11:19:55.708578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 189/346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:55 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:56.260213 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:56.260937 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:56.268484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.268930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.269725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.270340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.350809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:56.351693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:56.360363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.360835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.361786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.362223 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.458604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:56.459039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:56.461250 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:56.468554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e8cd9a59-4740-4485-af79-6ad432ffc009 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.211926 Jul 14 11:19:56.469678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 158/347] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:56 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:56.474975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bd506f94-2b08-4693-9a0c-87ab187d93d9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.129295 Jul 14 11:19:56.476506 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 190/348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:56 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:56.726358 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:56.726895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:56.736638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.737407 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.738789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:56.739621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:56.905338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:56.915692 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7a514b2a-216b-454f-bef3-d742f12cccc7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.193886 Jul 14 11:19:56.916277 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 159/349] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:56 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:57.487500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:57.488116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:57.490325 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=6 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:57.493871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:57.494577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:57.495379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.495832 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.496723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.497323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.498723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:57.499507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:57.506199 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.506810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.508166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.508801 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.586754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:57.595441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-14ea4096-ba54-474c-a12e-50a73ca55747 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.105841 Jul 14 11:19:57.596329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 160/350] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:57 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:57.668729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:57.677293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a33ae284-6ced-4a94-bd25-369d9ff85d02 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.193680 Jul 14 11:19:57.678121 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 191/351] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:57 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:57.934107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:57.934107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:57.940113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.940638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:57.943050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:57.943050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:58.089570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:58.100487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-efcb18a5-f038-41ba-bfad-d7cd94aadd29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.170828 Jul 14 11:19:58.101463 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 161/352] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:57 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:58.617917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:58.632508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:58.632508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:58.632952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:58.634806 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:58.635620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:58.698071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:58.698672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:58.705840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:58.706047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:58.706835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:58.709222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:58.709631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:58.718192 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8484d63b-734d-44c6-a7aa-d4e98c260d4d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.108801 Jul 14 11:19:58.718859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 192/353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:58 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:58.868751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:58.877407 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d74e650b-7bee-47f3-83ff-2f12bae3db33 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.183380 Jul 14 11:19:58.877983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 162/354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:58 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:59.118665 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:59.119508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:59.125575 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.126014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.126776 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.127235 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.288068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:59.295470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f1e29388-ff2d-4e49-9995-e6f844221258 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.180784 Jul 14 11:19:59.296025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 193/355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:59 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:19:59.747039 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:59.747039 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:59.748326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.748893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.749740 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.750232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.827567 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:19:59.836260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-95a95ac1-18db-4875-b3d3-b6b0f47b8599 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.103428 Jul 14 11:19:59.836830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 163/356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:59 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:19:59.896585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:19:59.898214 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:19:59.901196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:59.908206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.908206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:19:59.908206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:19:59.908206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.069391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:00.077212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4355165a-8e37-44ea-b66d-c7165588f0f1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.185060 Jul 14 11:20:00.077780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 194/357] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:19:59 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:00.313580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:00.314199 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:00.321327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.321774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.331644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.331644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.476594 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:00.485619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-20f92657-95a2-4ef0-ac58-5c271b3e69b6 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.175813 Jul 14 11:20:00.486405 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 164/358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:00 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:00.853519 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:00.854135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:00.860667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.861679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.861964 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:00.862404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:00.927141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:00.934894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fc39b686-76fe-4884-a4f9-8b92e7838fa9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.085587 Jul 14 11:20:00.935513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 195/359] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:00 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:01.095268 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:01.096823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:01.104080 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.104542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:01.105346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.105781 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:01.253678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:01.263967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-09bab0ed-1497-4eb4-9621-a4d83f98fdd1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.172031 Jul 14 11:20:01.265088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 165/360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:01 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:01.503851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:01.504525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:01.510780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.511257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:01.512047 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.512477 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:01.665710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:01.678454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9400bd2f-9ea0-420e-917a-aa4dc34d73a0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.178549 Jul 14 11:20:01.679377 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 196/361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:01 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:01.954526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:01.955168 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:01.963077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.963552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:01.964732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:01.965353 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:02.045138 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:02.056120 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-902ed707-e084-4de4-b569-694bfec3ad54 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.105414 Jul 14 11:20:02.056711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 166/362] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:01 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:02.291416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:02.292347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:02.301748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:02.302475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:02.303758 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:02.304400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:02.465244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:02.475167 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6c52d9e4-f485-441c-bf36-e5fa61e20b47 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.190025 Jul 14 11:20:02.475767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 197/363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:02 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:02.697164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:02.697732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:02.705119 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:02.705569 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:02.706371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:02.706855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:02.849752 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:02.860043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f65a7ed8-f441-448e-b662-66655ce3e761 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.167443 Jul 14 11:20:02.860617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 167/364] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:02 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:03.074563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:03.075217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:03.081674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.082130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.082997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.083477 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.147263 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:03.154800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bc5819c4-ac2e-4678-b6b9-1c222033980a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1250 microversion: 2.1 time: 0.084575 Jul 14 11:20:03.155412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 198/365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:03 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:03.499319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:03.502931 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:03.523911 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.524372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.525175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.525678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.858844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:03.858844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-749ce3d0-9bf3-4848-860d-453dd5d6dd62 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.366677 Jul 14 11:20:03.869103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 168/366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:03 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:03.879952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:03.881490 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:03.891012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.892026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:03.893495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:03.894483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:04.184999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:04.185782 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:04.201237 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:04.202459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:04.203297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:04.205604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:04.206564 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:04.224062 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-abed8e0f-f5c2-4197-a776-14d3c8fab7ce tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.349437 Jul 14 11:20:04.226312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 199/367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:03 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:04.599420 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:04.622580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-df3388a1-f5b7-4cdb-b7d3-7e5f61e0327e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1242 microversion: 2.1 time: 0.452489 Jul 14 11:20:04.625557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 169/368] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:04 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1242 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:04.878429 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:04.879470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:04.909042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:04.909042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:04.909042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:04.909042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.138617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:05.149043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-769f0417-a714-4c26-a5a6-92da98344c43 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.274858 Jul 14 11:20:05.149043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 200/369] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:04 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:05.244463 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:05.245125 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:05.251856 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.252306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.253203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.253641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.493016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:05.501601 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a2fd1238-0e2b-4688-8b0e-1e0d8016076b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.261907 Jul 14 11:20:05.502336 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 170/370] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:05 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:05.651481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:05.652567 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:05.659771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.660275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.661082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:05.661532 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:05.746136 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:05.757006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dbfcf2df-204a-431f-bc61-a84418997a75 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1298 microversion: 2.1 time: 0.107621 Jul 14 11:20:05.757258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 201/371] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:05 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:06.172285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:06.172816 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:06.180269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.180730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.181538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.181976 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.326998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:06.335741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-74468b72-9005-411b-a5f6-f6c89fb9f089 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.167413 Jul 14 11:20:06.336636 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 171/372] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:06 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:06.522402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:06.523015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:06.529259 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.529706 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.530486 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.530914 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.666217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:06.673624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-111f0318-7560-4590-9728-0c426415bc24 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.155916 Jul 14 11:20:06.674178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 202/373] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:06 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:06.773897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:06.774507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:06.781056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.781494 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.782284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:06.782718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:06.852644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:06.860854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d15e82ff-ae6d-40fe-b779-198eb42abdb1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.091097 Jul 14 11:20:06.861439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 172/374] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:06 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:07.353311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:07.353838 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:07.360447 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.360917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.361688 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.362233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.513144 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:07.517415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0a61cbaa-cbde-4e41-8a7a-7d52e6f541e6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.168265 Jul 14 11:20:07.517980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 203/375] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:07 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:07.691774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:07.692249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:07.699827 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.700312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.701154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.701602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.851880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:07.860349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-44ffd63f-15c5-4970-8a53-052cee3a4ab0 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.173168 Jul 14 11:20:07.861020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 173/376] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:07 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:07.879560 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:07.880169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:07.886800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.887324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.888152 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:07.888592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:07.957454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:07.966585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cd8da2bc-ebbd-4855-b452-d7244ed99b1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.091417 Jul 14 11:20:07.967258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 204/377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:07 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:08.537874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:08.538400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:08.546207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:08.547194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:08.548276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:08.548727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:08.702283 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:08.716058 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-080268c4-08c1-44fe-89e9-083cb5bbbc3d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.184022 Jul 14 11:20:08.716684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 174/378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:08 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:08.877540 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:08.888883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:08.888883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:08.888883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:08.888883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:08.889848 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:08.985232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:08.986290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:08.993689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:08.994146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:08.994953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:08.995446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:09.012995 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:09.036899 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:09.043600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:09.046569 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-53d824f6-87bf-4816-9049-55ff965a8941 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.172785 Jul 14 11:20:09.047223 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 205/379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:08 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:09.095414 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:09.101865 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b81d1710-51bb-40ed-a743-a0e75a302d5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.119969 Jul 14 11:20:09.102901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 175/380] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:08 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:09.734396 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:09.735010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:09.741344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:09.741793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:09.742566 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:09.743001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:09.915623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:09.923351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-84bcbef6-134d-47bc-a2ac-c3c1087995ab tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.193248 Jul 14 11:20:09.923910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 206/381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:09 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:10.076233 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:10.077277 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:10.085428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.085998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.086676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.087394 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.127804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:10.132725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:10.140971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.141716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.143035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.143035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.216891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:10.224488 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dcca9779-7c19-42da-bd8e-74ad7fccc511 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.107836 Jul 14 11:20:10.225112 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 207/382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:10 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:10.236946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:10.245593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-deb6e87f-3084-42bd-a66f-5051adc4b786 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.177002 Jul 14 11:20:10.246163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 176/383] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:10 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:10.940844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:10.941887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:10.948139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.948824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:10.949995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:10.950559 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.124457 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:11.136074 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4286be26-0af5-44c5-a203-68d50e851cb5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.199055 Jul 14 11:20:11.136648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 208/384] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:10 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:11.246725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:11.247557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:11.254661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:11.255116 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.259096 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:11.259559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.262796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:11.271233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:11.271233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:11.271233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.271233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:11.271687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:11.333668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:11.338421 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3eee380d-0159-46b6-b7d8-880efe3ad098 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.096694 Jul 14 11:20:11.343782 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 177/385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:11 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:11.415428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:11.422978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1dc3892f-1803-44d9-9156-ddd66423e247 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.164519 Jul 14 11:20:11.423561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 209/386] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:11 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:12.153214 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:12.153965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:12.160927 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.161431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.162211 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.162649 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.357417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:12.357861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:12.359029 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:12.365442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.365814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.365929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f13b85da-2426-48af-82ce-e9d377469765 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.216507 Jul 14 11:20:12.366794 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.367003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 178/387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:12 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:12.367696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.434284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:12.440531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:12.441381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:12.444842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9fe77930-667b-497b-a6db-a314b6fd1b18 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.089401 Jul 14 11:20:12.449450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.449979 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.450909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:12.451652 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 210/388] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:12 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:12.451920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:12.607882 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:12.615722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1f280505-6386-4701-b7cb-4c3ed9bff575 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.179130 Jul 14 11:20:12.616271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 179/389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:12 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:13.385609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:13.386384 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:13.392620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.393068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.393838 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.394267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.459837 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:13.460578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:13.467928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.468409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.469196 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.469637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.537604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:13.540736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:13.545976 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-49f6da75-4d44-4ff1-80cc-ceae8c62944b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.090228 Jul 14 11:20:13.546623 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 180/390] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:13 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:13.548453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-78c2663a-5f6c-4008-b797-b9963e9c8242 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.169594 Jul 14 11:20:13.549010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 211/391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:13 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:13.633404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:13.633938 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:13.640067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.640511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.641267 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:13.641705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:13.773570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:13.781627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-55b1a1b6-7aa7-4b76-958e-2378f565ba99 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.152815 Jul 14 11:20:13.782208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 181/392] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:13 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:14.564471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:14.565180 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:14.566044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:14.566680 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:14.572339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.572787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.573592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.574026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.574198 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.574798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.575636 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.576081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.641785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:14.650250 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e38555ef-d82d-48af-9eac-258dcd5d63db tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.090052 Jul 14 11:20:14.651059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 212/393] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:14 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:14.722097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:14.729650 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f8813906-e394-4b23-81d6-99271e71c150 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.167515 Jul 14 11:20:14.730218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 182/394] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:14 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:14.799723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:14.800413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:14.806698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.807281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.808341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:14.808771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:14.953275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:14.961994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2484acb7-9895-41f3-af1d-4f995aac0583 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.166329 Jul 14 11:20:14.962573 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 213/395] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:14 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:15.668857 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:15.669579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:15.677328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:15.677328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:15.677881 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:15.678322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:15.746432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:15.746835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:15.747241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:15.753581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:15.754113 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:15.754224 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2491c223-49ac-4b7b-8d80-740da6a09fb3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.090722 Jul 14 11:20:15.754805 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 183/396] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:15 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:15.755073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:15.755631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:15.921787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:15.932257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8aaefe9a-fb4b-43c7-b0d4-0c2b20938cbb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.190007 Jul 14 11:20:15.937211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 214/397] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:15 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:15.979150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:15.979838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:15.986481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:15.986929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:15.987726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:15.988159 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:16.130895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:16.139635 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-df42a0f2-9089-4067-b8d4-a317c8a5be2e tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.164591 Jul 14 11:20:16.140229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 184/398] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:15 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:16.189810 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-778d2893-b404-4540-9a78-d597b98e424b req-a468be51-ad2f-4583-94fa-36672502b6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eaab181-9ee3-430f-b33c-181879d97df0", "name": "network-vif-plugged", "status": "completed", "tag": "3d66bce9-9b3e-43f1-96c2-c33922393d16"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:16.200347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-778d2893-b404-4540-9a78-d597b98e424b req-a468be51-ad2f-4583-94fa-36672502b6c5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:16.200786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-778d2893-b404-4540-9a78-d597b98e424b req-a468be51-ad2f-4583-94fa-36672502b6c5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:16.213717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-778d2893-b404-4540-9a78-d597b98e424b req-a468be51-ad2f-4583-94fa-36672502b6c5 service nova] Creating event network-vif-plugged:3d66bce9-9b3e-43f1-96c2-c33922393d16 for instance 8eaab181-9ee3-430f-b33c-181879d97df0 on hv-cinder-82282 Jul 14 11:20:16.218897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-778d2893-b404-4540-9a78-d597b98e424b req-a468be51-ad2f-4583-94fa-36672502b6c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Jul 14 11:20:16.219530 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 215/399] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:16.771162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:16.771995 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:16.779158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:16.779652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:16.780478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:16.781060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:16.859731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:16.867038 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-73f30b89-cd81-406e-b99a-99841ff03488 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1306 microversion: 2.1 time: 0.099714 Jul 14 11:20:16.868637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 185/400] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:16 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:16.953245 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:16.953940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:16.960428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:16.960877 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:16.962033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:16.962637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:17.111512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:17.120522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-92788e6f-8b67-4f5b-88a7-1aae0e893b7e tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.171488 Jul 14 11:20:17.121294 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 216/401] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:16 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:17.157458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:17.158960 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:17.165894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:17.166356 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:17.167179 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:17.167619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:17.308942 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:17.317899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8d14dc6a-ae76-481e-adae-0d0b9ffcdf10 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.164355 Jul 14 11:20:17.318470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 186/402] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:17 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:17.888304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:17.891691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:17.898142 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:17.898677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:17.899660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:17.900108 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:17.984363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:17.994373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2486e1c7-9b9b-41d5-b5a5-75ce5bcbc92e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1316 microversion: 2.1 time: 0.112186 Jul 14 11:20:17.997616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 217/403] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:17 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1316 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:18.142943 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:18.145725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:18.151954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:18.166974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:18.167989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:18.170047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:18.170288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:18.342472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:18.344025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:18.369490 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:18.370270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:18.371521 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:18.372188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:18.589518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:18.589518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d15a87b7-b431-43ef-9ec5-a70521fc7a29 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.250393 Jul 14 11:20:18.589518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 218/404] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:18 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:18.611849 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:18.621550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6fc45c4f-a680-4faf-9d7b-345c3fd23615 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.486810 Jul 14 11:20:18.627287 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 187/405] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:18 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:19.017082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:19.017851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:19.024867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:19.025370 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:19.026167 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:19.026742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:19.258048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:19.269747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5c54abb6-2f51-4ca5-b818-34e9b39c9827 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.256705 Jul 14 11:20:19.270418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 219/406] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:19 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:19.621294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:19.621989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:19.640919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:19.641260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:19.642008 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:19.642190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:19.643367 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:19.644018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:19.652636 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:19.653612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:19.655063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:19.655861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:19.844046 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:19.852947 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:19.855490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fc62653f-c193-4932-8d5d-a0ef5c890ee8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.243675 Jul 14 11:20:19.856233 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 188/407] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:19 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:19.861207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-82d38321-6853-466f-8823-8e0c29c81d7d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.224933 Jul 14 11:20:19.861786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 220/408] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:19 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:20.293640 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:20.294429 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:20.302112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.302611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:20.303465 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.303996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:20.463011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-9a66cf06-e204-4e33-9440-68d20e963289 req-7e7e923f-7bae-4541-bb27-6aff32594dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64a13ae-3a63-4bdd-8113-cf2e9b4b3588", "tag": "46cab31c-2d94-46c2-a19b-9b2357606b0b"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:20.475774 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-9a66cf06-e204-4e33-9440-68d20e963289 req-7e7e923f-7bae-4541-bb27-6aff32594dd6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.476501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-9a66cf06-e204-4e33-9440-68d20e963289 req-7e7e923f-7bae-4541-bb27-6aff32594dd6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:20.500212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-9a66cf06-e204-4e33-9440-68d20e963289 req-7e7e923f-7bae-4541-bb27-6aff32594dd6 service nova] Creating event network-changed:46cab31c-2d94-46c2-a19b-9b2357606b0b for instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 on hv-cinder-82282 Jul 14 11:20:20.512621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-9a66cf06-e204-4e33-9440-68d20e963289 req-7e7e923f-7bae-4541-bb27-6aff32594dd6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052626 Jul 14 11:20:20.516702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 221/409] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:20:20.574325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:20.585483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-02bc9a71-eec7-4829-89c1-ed878a97dd5e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.298417 Jul 14 11:20:20.586409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 189/410] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:20 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:20.877729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:20.878890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:20.885112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:20.887771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:20.893455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.893455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:20.893790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.894243 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:20.896947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.897428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:20.898219 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:20.898871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:21.117574 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:21.135664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4ac668fb-7b78-4ffc-b991-472609335877 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.263786 Jul 14 11:20:21.160700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 222/411] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:20 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:21.160700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-fb23fc0a-90d1-4b64-bb8f-9adf88feab1d req-bee7e373-e167-43b0-9c26-1a92793c6dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "name": "network-vif-plugged", "status": "completed", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:21.168472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:21.168897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-fb23fc0a-90d1-4b64-bb8f-9adf88feab1d req-bee7e373-e167-43b0-9c26-1a92793c6dc4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:21.169346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-fb23fc0a-90d1-4b64-bb8f-9adf88feab1d req-bee7e373-e167-43b0-9c26-1a92793c6dc4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:21.177227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c1e59adb-d977-44db-aec0-ca8a2155a25a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1314 microversion: 2.1 time: 0.302025 Jul 14 11:20:21.178168 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 190/412] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:20 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:21.183161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-fb23fc0a-90d1-4b64-bb8f-9adf88feab1d req-bee7e373-e167-43b0-9c26-1a92793c6dc4 service nova] Creating event network-vif-plugged:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:20:21.188591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-fb23fc0a-90d1-4b64-bb8f-9adf88feab1d req-bee7e373-e167-43b0-9c26-1a92793c6dc4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033965 Jul 14 11:20:21.189252 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 223/413] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:20:21.605596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:21.606315 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:21.613992 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:21.615000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:21.617372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:21.619275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:22.108587 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:22.118052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5c600ae7-7381-4808-a4a4-495ec7de0fb5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.518157 Jul 14 11:20:22.123202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 191/414] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:21 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:22.163362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:22.164071 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:22.187808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:22.188270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:22.195437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:22.199869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:22.200109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:22.200708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:22.208956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:22.209381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:22.210393 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:22.223897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:22.229537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:22.242830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:22.397586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:22.408436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a3bec2a9-b9c4-49b0-a703-502c5d38703c tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.249671 Jul 14 11:20:22.409147 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 224/415] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:22 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:22.447425 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:22.463196 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cc0e2b65-395d-4fd3-b94a-fd9f872e89ad tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1499 microversion: 2.1 time: 0.270321 Jul 14 11:20:22.464443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 192/416] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:22 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1499 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:23.140374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:23.140890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:23.147555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:23.148094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:23.148919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:23.149363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:23.334115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:23.344882 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cced73c1-dbe5-4e05-b1c5-bd505176acf3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.208161 Jul 14 11:20:23.345476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 225/417] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:23 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:23.426182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:23.426792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:23.434562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:23.435011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:23.435833 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:23.436314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:23.626205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:23.640200 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e644c092-98fe-4d62-99d2-01bdc3d85a77 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1358 microversion: 2.1 time: 0.217871 Jul 14 11:20:23.641427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 193/418] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:23 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:23.648971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:23.649854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:23.658760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:23.659317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:23.660204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:23.660756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:23.692899 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:20:24.271308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ba157ffe-3019-4928-bce2-7ae68483e9a4 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 204 len: 0 microversion: 2.1 time: 0.635727 Jul 14 11:20:24.272769 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 226/419] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:20:23 2022] DELETE /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:20:24.291257 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:24.292703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:24.302538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.304124 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.305171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.305788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.363586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:24.364380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:24.374815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.374815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.374815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.376858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.489688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:24.502883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3d59b460-706f-45cf-abe8-49e04fdd27bd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.224669 Jul 14 11:20:24.503532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 194/420] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:24 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:24.546461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:24.556114 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-68ccdb80-018e-487c-aab1-21cc9f451bb9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.196687 Jul 14 11:20:24.556826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 227/421] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:24 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:24.667459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:24.668306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:24.677005 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.677606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.678696 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.679356 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.844244 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:24.852507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ce7aa11c-e52e-47ae-b79f-a9bdde907d63 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1549 microversion: 2.1 time: 0.190300 Jul 14 11:20:24.863973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 195/422] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:24 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:24.871697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:24.872305 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:24.885019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.885624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:24.886483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:24.886920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.029614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:25.037970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-17f78b26-6649-4f94-809d-a1159709f5bf tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1549 microversion: 2.1 time: 0.171313 Jul 14 11:20:25.038541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 228/423] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:24 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:25.053380 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:25.057851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:25.058673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Searching by: {'deleted': False, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f'} {{(pid=118244) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 11:20:25.065503 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.065957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.066766 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.067305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.161009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.multi_cell_list [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118244) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 11:20:25.257026 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5857689c-0b4a-4876-8b63-abf0eac5e32d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207365 Jul 14 11:20:25.257828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 196/424] 10.222.0.59 () {58 vars in 1124 bytes} [Thu Jul 14 11:20:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:25.268993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:25.269606 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:25.276578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.277024 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.277793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.278231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.420901 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:25.428616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4b81ae26-7e0f-4f45-8d84-894d1c353e70 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1549 microversion: 2.1 time: 0.163705 Jul 14 11:20:25.429182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 229/425] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:25 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:25.521505 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:25.522124 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:25.528732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.529181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.529950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.530517 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.582057 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:25.582722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:25.590705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.591274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.592130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:25.592634 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:25.679878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:25.687735 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-468ccef9-6771-45ff-9e64-62b8889bf3e1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.170244 Jul 14 11:20:25.688306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 197/426] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:25 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:25.731550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:25.739569 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-059ec62a-e90b-4868-ac92-4e81d2dd5f2c tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.161519 Jul 14 11:20:25.740341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 230/427] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:25 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:26.111686 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1337296331", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "networks": [{"uuid": "c41b0fb2-58cf-4c60-9ffd-8bd4aceb700e"}]}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:26.167542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] validate_networks() for [('c41b0fb2-58cf-4c60-9ffd-8bd4aceb700e', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:20:26.565378 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:20:26.565958 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:20:26.566261 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:20:26.566677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:20:26.567087 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:20:26.577594 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:26.578062 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:26.578929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:26.579405 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:26.598032 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Getting quotas for project 11215c9c5f59498c8110024722b1529c. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:20:26.602479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Getting quotas for user ee2e478cdbb04617b48f388a4b38bd35 and project 11215c9c5f59498c8110024722b1529c. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:20:26.614286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:20:26.616556 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:20:26.711143 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:26.711775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:26.722372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:26.722868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:26.725772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:26.725772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:26.769176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0304db81-8e85-4799-9b5f-aaca677cf29b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664630 Jul 14 11:20:26.774578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 198/428] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:20:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:20:26.774781 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:26.775396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:26.792704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:26.792704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:26.792704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:26.792704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:26.896995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:26.907951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9bbe8cd6-387b-4cec-8d18-e0ad1102771d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.204426 Jul 14 11:20:26.920216 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 231/429] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:26 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:26.959992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0ebed35e-1345-416e-8f84-9116e439e32b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:26.959992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0ebed35e-1345-416e-8f84-9116e439e32b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:26.976050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:26.986280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a91f1845-9b52-42de-ad9f-d8a2d1ba6266 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.215373 Jul 14 11:20:26.987863 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 199/430] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:26 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:27.002444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0ebed35e-1345-416e-8f84-9116e439e32b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:27.009274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0ebed35e-1345-416e-8f84-9116e439e32b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1219 microversion: 2.1 time: 0.087428 Jul 14 11:20:27.009895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 232/431] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:26 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:27.933656 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:27.934271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:27.940980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:27.941430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:27.942206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:27.942648 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:28.005328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:28.005946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:28.013775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:28.014171 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:28.014950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:28.015419 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:28.116221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:28.118276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b1525cec-2e57-47d7-b950-1200ec510435 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.188417 Jul 14 11:20:28.118812 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 200/432] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:27 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:28.129122 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-684338c0-235f-4689-93c2-4e0ebcf90c9c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:28.129122 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-684338c0-235f-4689-93c2-4e0ebcf90c9c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:28.205409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:28.206676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-684338c0-235f-4689-93c2-4e0ebcf90c9c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:28.214193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-684338c0-235f-4689-93c2-4e0ebcf90c9c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1219 microversion: 2.1 time: 0.093815 Jul 14 11:20:28.215078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 201/433] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:28 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:28.220503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-718aa6f5-4667-434a-88bb-8345d399bf14 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.219130 Jul 14 11:20:28.221062 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 233/434] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:27 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:28.237739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2117792109", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:28.295606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] validate_networks() for None {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:20:28.601280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:20:28.601714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:20:28.602194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:20:28.602610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:20:28.603028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:20:28.613133 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:28.613688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:28.614522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:28.615064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:28.655831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Getting quotas for project fff6b9f656b24b4a8b5724f9a0078b2f. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:20:28.655831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Getting quotas for user 6a5a5aa9ccde4aa0ac0362b11010f5c0 and project fff6b9f656b24b4a8b5724f9a0078b2f. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:20:28.655831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:20:28.655831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:20:28.829967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-27280b09-997c-492c-b195-253ab4c69701 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595563 Jul 14 11:20:28.831352 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 202/435] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:20:28.842933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bf31eee5-3099-412d-90ca-613cfdf7481e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:28.843562 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bf31eee5-3099-412d-90ca-613cfdf7481e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:28.921430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bf31eee5-3099-412d-90ca-613cfdf7481e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:28.934833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bf31eee5-3099-412d-90ca-613cfdf7481e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1215 microversion: 2.1 time: 0.097239 Jul 14 11:20:28.942665 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 234/436] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:28 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:29.140285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:29.140903 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:29.147722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.148181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.148961 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.149441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.239998 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:29.241593 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:29.252371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.253247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.254687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.255500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.329816 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:29.340518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-10a047fb-3d1a-4b62-85d5-6093247c2921 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.205988 Jul 14 11:20:29.341372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 203/437] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:29 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:29.342336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:29.349004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:29.350945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:29.357231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-19e1e7f2-4323-4957-ab7c-125df9d2e7f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1223 microversion: 2.1 time: 0.124951 Jul 14 11:20:29.359388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.359638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 235/438] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:29 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:29.367427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.367427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.367427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.518203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:29.524152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-485b0a01-9dcb-4365-b241-91e0888513ee tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.181700 Jul 14 11:20:29.524749 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 204/439] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:29 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:29.889660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6884ff7-481b-4afe-b7ad-2636ba084c15"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:29.890854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:29.897197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.897667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.898471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:29.898902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:29.952504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-99ed3b92-694d-47b5-b215-e90c5c835b2c tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:29.953355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-99ed3b92-694d-47b5-b215-e90c5c835b2c tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:30.016883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-99ed3b92-694d-47b5-b215-e90c5c835b2c tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:30.023764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-99ed3b92-694d-47b5-b215-e90c5c835b2c tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1215 microversion: 2.1 time: 0.075526 Jul 14 11:20:30.024391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 205/440] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:29 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:30.362839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:30.363595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:30.370518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:30.371269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:30.372971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:30.373409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:30.528593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:30.536242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c9fdbefb-b6c8-45f8-ba18-00feee3c0df0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.180861 Jul 14 11:20:30.536819 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 206/441] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:30 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:30.541355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:30.542551 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:30.551152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:30.551629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:30.552471 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:30.552914 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:30.624007 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:30.633060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8f22f220-b545-4ccf-b320-5467faddcc4f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1223 microversion: 2.1 time: 0.095189 Jul 14 11:20:30.633841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 207/442] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:30 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:30.641957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:30.643246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:30.653431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:30.659256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:30.659256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:30.659256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:30.845325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:30.853131 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b27c6bf8-32f6-4857-b20f-e2f0417cfa5b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.217684 Jul 14 11:20:30.853721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 208/443] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:30 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:31.041340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:31.042042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:31.048957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.049408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.050192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.050650 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.144424 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:31.157409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6cb26bd5-010a-4e78-a67f-3c529db5cd33 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1211 microversion: 2.1 time: 0.120005 Jul 14 11:20:31.158085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 209/444] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:31 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:31.511514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f10e6b43-3fbf-4ec9-9f10-fae167dfbdd9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.625155 Jul 14 11:20:31.518730 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 236/445] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:20:29 2022] POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments => generated 194 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:31.561971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:31.564190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:31.576128 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.577264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.579015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.579854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.650394 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:31.651181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:31.654004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:31.660104 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.660551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.661327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.661764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.759493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:31.771949 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-40adca82-fece-4f9c-ab66-53cf5765ed42 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1271 microversion: 2.1 time: 0.125711 Jul 14 11:20:31.772787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 237/446] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:31 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:31.842343 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:31.850766 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-62de1009-33f5-4c90-8f0b-7aa9e2ca518d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1505 microversion: 2.1 time: 0.299646 Jul 14 11:20:31.860699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 210/447] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:31 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:31.874275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:31.875055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:31.886155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.888026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:31.888867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:31.889349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.049310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:32.058842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-995df084-a957-4198-9b6c-7182b640eddc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.189166 Jul 14 11:20:32.059473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 238/448] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:31 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:32.179423 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:32.180804 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:32.194886 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.196710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.197715 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.199270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.203919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-d4e5b783-15b4-4785-8880-ee1fe18a84f2 req-ce7e9cea-f8c7-4a27-bae2-7b53b2a45e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eaab181-9ee3-430f-b33c-181879d97df0", "name": "network-vif-deleted", "tag": "3d66bce9-9b3e-43f1-96c2-c33922393d16"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:32.212042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d4e5b783-15b4-4785-8880-ee1fe18a84f2 req-ce7e9cea-f8c7-4a27-bae2-7b53b2a45e94 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.212493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d4e5b783-15b4-4785-8880-ee1fe18a84f2 req-ce7e9cea-f8c7-4a27-bae2-7b53b2a45e94 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.225557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-d4e5b783-15b4-4785-8880-ee1fe18a84f2 req-ce7e9cea-f8c7-4a27-bae2-7b53b2a45e94 service nova] Creating event network-vif-deleted:3d66bce9-9b3e-43f1-96c2-c33922393d16 for instance 8eaab181-9ee3-430f-b33c-181879d97df0 on hv-cinder-82282 Jul 14 11:20:32.230762 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-d4e5b783-15b4-4785-8880-ee1fe18a84f2 req-ce7e9cea-f8c7-4a27-bae2-7b53b2a45e94 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030189 Jul 14 11:20:32.231462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 239/449] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:20:32.266143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:32.268446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:32.275111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-409a4554-3f80-4627-b8fb-0f15ffbdd82d tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1267 microversion: 2.1 time: 0.102160 Jul 14 11:20:32.275710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 211/450] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:32 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:32.794687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:32.796167 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:32.803614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.804077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.804871 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.805342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.871391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:32.872525 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:32.891753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.897522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.901676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.904467 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.936537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:32.940683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:32.949586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fb0e594b-2e99-4350-9999-2d6f14f44ce3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1279 microversion: 2.1 time: 0.159811 Jul 14 11:20:32.950604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 240/451] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:32 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:32.968737 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:32.969221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:32.969693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lazy-loading 'fault' on Instance uuid 8eaab181-9ee3-430f-b33c-181879d97df0 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:20:33.078339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:33.079372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:33.087875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.088486 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:33.090651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.091152 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:33.201804 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:33.217629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-411db1ca-ace9-49e3-8170-5f18c20eaffd tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 200 len: 1304 microversion: 2.1 time: 0.351721 Jul 14 11:20:33.219166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 212/452] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:32 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 1304 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:33.289977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:33.293907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:33.294464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:33.299697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e3f7b894-7eb5-4cea-a2db-a3edb367831d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.227381 Jul 14 11:20:33.300283 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 241/453] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:33 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:33.305826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.306556 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:33.310554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.310554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:33.392203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:33.401013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-72bdbbf8-bbd5-4435-b31d-bbbaeb80ac37 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1285 microversion: 2.1 time: 0.111954 Jul 14 11:20:33.402544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 213/454] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:33 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:33.658774 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-e322a32a-943b-407a-a95c-0214f62796ff req-6e6b05e2-bb2e-474b-9161-132f6bd31960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64a13ae-3a63-4bdd-8113-cf2e9b4b3588", "name": "network-vif-plugged", "status": "completed", "tag": "46cab31c-2d94-46c2-a19b-9b2357606b0b"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:33.668470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e322a32a-943b-407a-a95c-0214f62796ff req-6e6b05e2-bb2e-474b-9161-132f6bd31960 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.669017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e322a32a-943b-407a-a95c-0214f62796ff req-6e6b05e2-bb2e-474b-9161-132f6bd31960 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:33.703197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-e322a32a-943b-407a-a95c-0214f62796ff req-6e6b05e2-bb2e-474b-9161-132f6bd31960 service nova] Creating event network-vif-plugged:46cab31c-2d94-46c2-a19b-9b2357606b0b for instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 on hv-cinder-82282 Jul 14 11:20:33.710125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-e322a32a-943b-407a-a95c-0214f62796ff req-6e6b05e2-bb2e-474b-9161-132f6bd31960 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058253 Jul 14 11:20:33.711434 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 242/455] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:33.969138 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:33.970911 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:33.981136 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.982316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:33.983608 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:33.984535 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.076978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:34.085934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-562657c8-ca0d-4c10-8608-cdf9dc02d3d2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1277 microversion: 2.1 time: 0.121577 Jul 14 11:20:34.087017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 214/456] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:33 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:34.240950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:34.241683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: 8eaab181-9ee3-430f-b33c-181879d97df0] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:34.254019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:34.254522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.255391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:34.255854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.271778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] HTTP exception thrown: Instance 8eaab181-9ee3-430f-b33c-181879d97df0 could not be found. Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Request method failure captured: Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 HTTP/1.1 Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_urQ5Y6nTf5RUa9BhJHUye7w21qE38oz3PIO0NrNVnqmXbVNhfnn2yd1AalV6P71YAifC4aH3BOpLcx4dL-V-DQYRe2ICwrZ7pJGJaKpokab-G0Hdc017vor_K741OpSc0_7v-Vyzsqmjvzooens1SEGXuL95lzP9CY2AkUypQpM0I Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 76d33745da9045b989026dad3b5b7abb Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesActionsTest-878374332 Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:20:34.273413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76d33745da9045b989026dad3b5b7abb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76d33745da9045b989026dad3b5b7abb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76d33745da9045b989026dad3b5b7abb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76d33745da9045b989026dad3b5b7abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesActionsTest-878374332 Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 76d33745da9045b989026dad3b5b7abb Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesActionsTest-878374332 Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesActionsTest-878374332-project Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 162160bbb86e40c9bb957a213034e25f Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesActionsTest-878374332-project Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 8eaab181-9ee3-430f-b33c-181879d97df0 could not be found. Jul 14 11:20:34.274813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '8eaab181-9ee3-430f-b33c-181879d97df0'} Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eaab181-9ee3-430f-b33c-181879d97df0 could not be found. Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:20:34.275796 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eaab181-9ee3-430f-b33c-181879d97df0 could not be found. Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eaab181-9ee3-430f-b33c-181879d97df0 could not be found. Jul 14 11:20:34.277864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:20:34.280217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Returning 404 to user: Instance 8eaab181-9ee3-430f-b33c-181879d97df0 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:20:34.281103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-022c3481-3215-45bc-8a71-768141cf0820 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0" status: 404 len: 111 microversion: 2.1 time: 0.044443 Jul 14 11:20:34.281654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 243/457] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:34 2022] GET /compute/v2.1/servers/8eaab181-9ee3-430f-b33c-181879d97df0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:20:34.325356 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:34.326173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:34.333329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:34.333820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.334726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:34.335252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.422272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-960983343", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "networks": [{"uuid": "c6ac840a-5f03-40f9-b6b7-bdb362dbb235"}]}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:34.479615 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] validate_networks() for [('c6ac840a-5f03-40f9-b6b7-bdb362dbb235', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:20:34.807100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:34.819726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ba5f318b-53d9-427a-b3ae-096e0a81cec2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.498832 Jul 14 11:20:34.831319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 215/458] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:34 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:34.836756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:34.837586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:34.844530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:34.845273 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.846221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:34.846818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:34.997253 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:20:34.997825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:20:34.998317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:20:34.999084 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:20:34.999236 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:20:35.008552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:35.009111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:35.009957 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:35.010500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:35.029585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Getting quotas for project 76d33745da9045b989026dad3b5b7abb. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:20:35.033672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Getting quotas for user 162160bbb86e40c9bb957a213034e25f and project 76d33745da9045b989026dad3b5b7abb. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:20:35.051001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:20:35.053408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:20:35.056668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:35.065808 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3f5c0129-d812-42dc-bc85-f3c17b497852 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1273 microversion: 2.1 time: 0.233083 Jul 14 11:20:35.067169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 216/459] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:34 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:35.116813 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:35.118021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:35.128788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:35.129897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:35.131694 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:35.132457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:35.241883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-359e7f7c-e9f2-4ddc-a2d0-4e11dedf2daf tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823871 Jul 14 11:20:35.243306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 244/460] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:20:35.254899 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-27359ab3-20fe-4eca-accd-b9000de8d030 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:35.255710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-27359ab3-20fe-4eca-accd-b9000de8d030 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:35.322787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-27359ab3-20fe-4eca-accd-b9000de8d030 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:35.333690 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-27359ab3-20fe-4eca-accd-b9000de8d030 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1213 microversion: 2.1 time: 0.083352 Jul 14 11:20:35.334922 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 245/461] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:35 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:35.342854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:35.350499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0c10fc5c-6758-41c9-8297-d4001b8fb8f7 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.240882 Jul 14 11:20:35.351600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 217/462] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:35 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:35.842517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:35.844373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:35.856433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:35.865470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:35.865470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:35.865470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.052282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:36.065679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-804789f5-d3b5-44b7-8a85-03b08f0aa108 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.229738 Jul 14 11:20:36.066260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 246/463] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:35 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:36.085942 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:36.086576 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:36.093439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.093901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.094697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.095161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.362613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bcc8f9e7-f931-4989-92ea-b316ad1a641d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:36.363733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bcc8f9e7-f931-4989-92ea-b316ad1a641d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:36.441124 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bcc8f9e7-f931-4989-92ea-b316ad1a641d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:36.447397 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:36.449956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bcc8f9e7-f931-4989-92ea-b316ad1a641d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1213 microversion: 2.1 time: 0.096361 Jul 14 11:20:36.450500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 247/464] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:36 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:36.455800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:36.456887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:36.472928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-33c19344-b030-4da0-821b-73815f572356 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.391060 Jul 14 11:20:36.473348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.473828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.474049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 218/465] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:36 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:36.475272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.475753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.653669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:36.661373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ff354e11-d86e-4f4f-9aa3-2b193921be39 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.209560 Jul 14 11:20:36.661935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 248/466] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:36 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:36.932731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-1a0c7dd4-42ef-428e-98e7-cd9d78626a88 req-c4204085-5ea6-4860-918e-f06c81bbea36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2", "tag": "4b6c8e7f-12ba-40ff-be49-a22f4f2ee1b2"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:36.943061 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-1a0c7dd4-42ef-428e-98e7-cd9d78626a88 req-c4204085-5ea6-4860-918e-f06c81bbea36 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:36.943930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-1a0c7dd4-42ef-428e-98e7-cd9d78626a88 req-c4204085-5ea6-4860-918e-f06c81bbea36 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:36.960269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-1a0c7dd4-42ef-428e-98e7-cd9d78626a88 req-c4204085-5ea6-4860-918e-f06c81bbea36 service nova] Creating event network-changed:4b6c8e7f-12ba-40ff-be49-a22f4f2ee1b2 for instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 on hv-cinder-82282 Jul 14 11:20:36.967311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-1a0c7dd4-42ef-428e-98e7-cd9d78626a88 req-c4204085-5ea6-4860-918e-f06c81bbea36 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038165 Jul 14 11:20:36.968455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 219/467] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:37.085800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:37.086420 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:37.095043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.095527 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.096303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.096748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.157939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:37.158676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:37.163377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:37.169148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.170412 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.172027 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.172705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.412742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:37.435083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6b5ccd81-43ca-4d94-8268-61db6f4b5243 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.351348 Jul 14 11:20:37.437157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 249/468] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:37 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:37.478678 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:37.480078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:37.505433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.505433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.505433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.505433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.624293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:37.633460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1ff49edb-b891-4f70-bdd7-f5684a2297fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1217 microversion: 2.1 time: 0.161597 Jul 14 11:20:37.634326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 250/469] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:37 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:37.639958 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:37.640818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:37.644482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:37.648600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.648600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.649375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.649820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.661949 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-75405f61-9add-445a-9752-5e684ed27377 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1595 microversion: 2.1 time: 0.511122 Jul 14 11:20:37.663170 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 220/470] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:37 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1595 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:37.685314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:37.685314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:37.691522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.692361 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.693957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:37.694790 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:37.892493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:37.904687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-085d6b70-9538-41e0-9057-f3fb5ebb1b62 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.268857 Jul 14 11:20:37.905752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 251/471] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:37 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:37.926605 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:37.942520 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-744a14e7-e8b6-431d-bc22-d784e99bcd9d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.265275 Jul 14 11:20:37.943379 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 221/472] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:37 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:38.460563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:38.461226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:38.468928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.469768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:38.470580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.471016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:38.656719 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:38.658148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:38.661835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:38.674144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.674923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:38.676247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.676836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:38.724192 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:38.738054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-051c46ef-4f4c-4115-a85b-eacbe2bbda58 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1372 microversion: 2.1 time: 0.280907 Jul 14 11:20:38.739102 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 252/473] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:38 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:38.927504 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:38.928600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:38.938534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.939441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:38.940449 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:38.950785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:39.078383 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:39.092653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2d2080c1-1489-4cae-b4fa-2b6255cc5dec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1209 microversion: 2.1 time: 0.440391 Jul 14 11:20:39.093677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 222/474] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:38 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1209 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:39.108479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:39.109997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:39.122190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:39.122965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:39.124447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:39.125249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:39.340021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:39.364596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f7d56513-c126-42e9-a51b-06ac03386253 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.442053 Jul 14 11:20:39.365715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 253/475] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:38 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:39.379986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-f2b34c2c-ebdd-4083-be73-1640454300db req-254ade07-fa39-4c1c-945d-6529e0dfd23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ec1d2d-99c0-41e3-a22a-08c1f71734f6", "tag": "8f82a134-7a70-4f7b-9602-3c901f83fc0c"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:39.391486 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-f2b34c2c-ebdd-4083-be73-1640454300db req-254ade07-fa39-4c1c-945d-6529e0dfd23f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:39.391950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-f2b34c2c-ebdd-4083-be73-1640454300db req-254ade07-fa39-4c1c-945d-6529e0dfd23f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:39.409228 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-f2b34c2c-ebdd-4083-be73-1640454300db req-254ade07-fa39-4c1c-945d-6529e0dfd23f service nova] Creating event network-changed:8f82a134-7a70-4f7b-9602-3c901f83fc0c for instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 on hv-cinder-82282 Jul 14 11:20:39.416078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-f2b34c2c-ebdd-4083-be73-1640454300db req-254ade07-fa39-4c1c-945d-6529e0dfd23f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047527 Jul 14 11:20:39.416819 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 254/476] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:39.431322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:39.438539 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-afafe36f-fddd-41e5-bf94-39b462a3c285 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.342058 Jul 14 11:20:39.439031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 223/477] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:39 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:39.764988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:39.770719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:39.773373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:39.773961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:39.774932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:39.775570 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.031538 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:40.043200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-72fdb2cf-ba1d-49d7-b36a-a59a9759357a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1566 microversion: 2.1 time: 0.283688 Jul 14 11:20:40.044765 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 255/478] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:39 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:40.069435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:40.070951 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:40.077634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=16 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:40.084031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.084843 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.085849 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.086543 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.123044 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:40.124365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:40.132594 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.133217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.134209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.134769 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.220736 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ef9a410d-0086-445a-bbb8-4f281840e56f tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155917 Jul 14 11:20:40.230643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 224/479] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:20:40 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:40.384300 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:40.386158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:40.387742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:40.395395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.402497 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.403323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8281b8e7-e19d-4d91-9668-98aceb33e4b6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1273 microversion: 2.1 time: 0.281456 Jul 14 11:20:40.403588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.403588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.405346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 256/480] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:40 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:40.461041 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:40.461741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:40.469558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.470001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.471072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:40.471647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:40.759582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:40.780504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7d7d83d0-1b90-4511-87ea-c7f2b4a3637b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.398695 Jul 14 11:20:40.783900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 225/481] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:40 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:41.005921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:41.021631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4d43ea30-94f5-445a-a569-4917de1c551c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.564507 Jul 14 11:20:41.023006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 257/482] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:40 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:41.423321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:41.424653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:41.436495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.437407 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.438691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.439493 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.532593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:41.547921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-53618f7c-68f1-4cb5-96ed-437fa8e9e4c9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1283 microversion: 2.1 time: 0.131640 Jul 14 11:20:41.548714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 226/483] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:41 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1283 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:41.793059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-2c92a154-9029-4ad5-b679-0600fad304c8 req-74f236e7-43b3-4213-93f5-e2bca74f1a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:41.806233 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:41.807040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:41.832296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.832296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.832296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.832296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.843921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-2c92a154-9029-4ad5-b679-0600fad304c8 req-74f236e7-43b3-4213-93f5-e2bca74f1a6f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:41.845212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-2c92a154-9029-4ad5-b679-0600fad304c8 req-74f236e7-43b3-4213-93f5-e2bca74f1a6f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:41.899605 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-2c92a154-9029-4ad5-b679-0600fad304c8 req-74f236e7-43b3-4213-93f5-e2bca74f1a6f service nova] Creating event network-changed:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:20:41.919894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-2c92a154-9029-4ad5-b679-0600fad304c8 req-74f236e7-43b3-4213-93f5-e2bca74f1a6f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133652 Jul 14 11:20:41.929496 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 258/484] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:20:42.055857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:42.055857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:42.059201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.060639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.061814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.062455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.205957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:42.220631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c3f107f5-0b9e-45f8-9060-bc0dbaee6a7a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.422477 Jul 14 11:20:42.222420 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 227/485] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:41 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:42.340093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:42.360270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d692bd9e-5191-463f-a725-4484766ed6fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.317489 Jul 14 11:20:42.361623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 259/486] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:42 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:42.457841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-8def3ec6-b904-43fe-8310-412eab31e058 req-ce696f1e-8890-47ae-bece-f91baa7eb82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64a13ae-3a63-4bdd-8113-cf2e9b4b3588", "tag": "46cab31c-2d94-46c2-a19b-9b2357606b0b"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:42.469914 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-8def3ec6-b904-43fe-8310-412eab31e058 req-ce696f1e-8890-47ae-bece-f91baa7eb82c service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.470337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-8def3ec6-b904-43fe-8310-412eab31e058 req-ce696f1e-8890-47ae-bece-f91baa7eb82c service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.484970 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-8def3ec6-b904-43fe-8310-412eab31e058 req-ce696f1e-8890-47ae-bece-f91baa7eb82c service nova] Creating event network-changed:46cab31c-2d94-46c2-a19b-9b2357606b0b for instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 on hv-cinder-82282 Jul 14 11:20:42.491688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-8def3ec6-b904-43fe-8310-412eab31e058 req-ce696f1e-8890-47ae-bece-f91baa7eb82c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037956 Jul 14 11:20:42.492967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 228/487] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:20:42.573876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:42.575732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:42.585322 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.585811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.586916 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:42.587410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:42.803680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:42.816215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b9928d50-596a-4e02-ae42-52e61054be68 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1325 microversion: 2.1 time: 0.249364 Jul 14 11:20:42.824054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 260/488] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:42 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:43.245739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:43.246655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:43.257627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.258411 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.259457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.260062 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.400017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:43.400642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:43.420168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.421104 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.426856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.430179 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.533698 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:43.541847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:43.550824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-72bc6b2d-c783-41fd-b239-ad563ea428c1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.311362 Jul 14 11:20:43.556261 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 229/489] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:43 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:43.666544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:43.677108 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-28c7560b-c7a1-4e9a-996d-bd87ba7675bb tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.282109 Jul 14 11:20:43.677736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 261/490] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:43 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:43.844672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:43.845858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:43.858284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.859303 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:43.860753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:43.861468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:44.048470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:44.060503 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2d32b5dc-f07d-4391-9439-230b6d355568 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1325 microversion: 2.1 time: 0.222224 Jul 14 11:20:44.061831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 230/491] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:43 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:44.574807 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:44.576727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:44.583403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:44.583927 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:44.584780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:44.585214 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:44.696688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:44.697568 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:44.705297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:44.705917 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:44.706714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:44.707369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:44.859182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:44.864447 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:44.869227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-57e127fb-274b-4029-9771-5f9c12de5be8 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.299641 Jul 14 11:20:44.869805 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 262/492] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:44 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:44.902932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:44.914300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b7f9cca5-8dd7-4c2f-9292-0123c48ebf5e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.221748 Jul 14 11:20:44.915331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 231/493] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:44 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:45.084886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:45.085364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:45.088677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:45.094715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.095633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.096327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.096908 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.340513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:45.349026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-da6950cf-a75d-407b-841e-18dc87dc5e78 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.269233 Jul 14 11:20:45.349600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 263/494] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:45 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:45.579672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-5b52750a-f3a0-47b1-bd62-23e51d28ffa9 req-ee90134e-3463-4fe8-bab6-b9dd3ba25b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e936032b-9d29-4116-8978-99d36831ffd8", "tag": "63958558-7b66-40b7-80b2-428eca7c1303"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:45.592634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-5b52750a-f3a0-47b1-bd62-23e51d28ffa9 req-ee90134e-3463-4fe8-bab6-b9dd3ba25b85 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.593387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-5b52750a-f3a0-47b1-bd62-23e51d28ffa9 req-ee90134e-3463-4fe8-bab6-b9dd3ba25b85 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.609216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-5b52750a-f3a0-47b1-bd62-23e51d28ffa9 req-ee90134e-3463-4fe8-bab6-b9dd3ba25b85 service nova] Creating event network-changed:63958558-7b66-40b7-80b2-428eca7c1303 for instance e936032b-9d29-4116-8978-99d36831ffd8 on hv-cinder-82282 Jul 14 11:20:45.615949 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-5b52750a-f3a0-47b1-bd62-23e51d28ffa9 req-ee90134e-3463-4fe8-bab6-b9dd3ba25b85 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042105 Jul 14 11:20:45.616562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 232/495] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:45.896905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:45.897782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:45.907659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.908420 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.910031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.910800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.949085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:45.958521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:45.969170 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.969880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:45.970670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:45.971248 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.104083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:46.118700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-108e83c8-9553-4f9e-8ace-9fbf25409855 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.226221 Jul 14 11:20:46.120012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 264/496] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:45 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:46.157868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:46.168375 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-98d8bb1a-10c5-4c6d-92d8-922d94348105 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.228109 Jul 14 11:20:46.170080 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 233/497] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:45 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:46.310815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-824085093"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:46.311840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:46.321087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.321590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.323031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.323834 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.366671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:46.367487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:46.376310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.377382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.377778 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:46.378329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:46.446155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=14 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:46.494871 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.network.security_group_api [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Adding security group 5bea9673-7d18-46ef-917c-4a4edbe0d6e3 to port 263c0415-7821-4d36-9386-148556baecd3 Jul 14 11:20:46.536743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:46.546178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7d60c86b-74e5-4ad1-907d-e5680a9fe4fb tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.182971 Jul 14 11:20:46.547194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 234/498] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:46 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:47.056123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-be83ae74-45e2-4672-8d30-10423a0bae30 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/action" status: 202 len: 0 microversion: 2.1 time: 0.751869 Jul 14 11:20:47.056949 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 265/499] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:20:46 2022] POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:20:47.066850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:47.068554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:47.080134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.080651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.081818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.081986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.149504 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:47.150571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:47.161277 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.181525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.181525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.181525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.399723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:47.410839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f97a3fbb-3f80-4c13-9a71-77bfddb048d5 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1641 microversion: 2.1 time: 0.347493 Jul 14 11:20:47.412107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 235/500] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:47 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1641 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:47.417791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:47.418403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:47.425580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.427579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.428692 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.429355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.439499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:47.452238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8814d0f2-6911-48fc-a4d2-ac26bf905e42 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.311602 Jul 14 11:20:47.452940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 266/501] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:47 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:47.459609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-ad22a815-5039-4599-b37f-ddbcc4288ef7 req-368bdd14-e9e5-43f7-9d3b-ccc93f1e49ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ec1d2d-99c0-41e3-a22a-08c1f71734f6", "name": "network-vif-plugged", "status": "completed", "tag": "8f82a134-7a70-4f7b-9602-3c901f83fc0c"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:47.474102 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-ad22a815-5039-4599-b37f-ddbcc4288ef7 req-368bdd14-e9e5-43f7-9d3b-ccc93f1e49ef service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.474792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-ad22a815-5039-4599-b37f-ddbcc4288ef7 req-368bdd14-e9e5-43f7-9d3b-ccc93f1e49ef service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.490142 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-ad22a815-5039-4599-b37f-ddbcc4288ef7 req-368bdd14-e9e5-43f7-9d3b-ccc93f1e49ef service nova] Creating event network-vif-plugged:8f82a134-7a70-4f7b-9602-3c901f83fc0c for instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 on hv-cinder-82282 Jul 14 11:20:47.496862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-ad22a815-5039-4599-b37f-ddbcc4288ef7 req-368bdd14-e9e5-43f7-9d3b-ccc93f1e49ef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041908 Jul 14 11:20:47.497333 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 267/502] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:47.571417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:47.572432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:47.581473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.582031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.583616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.584379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.603611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:47.612509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dcc3ba9d-3d1b-4c9f-b0f8-8ecc8afe500e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.198758 Jul 14 11:20:47.613452 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 236/503] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:47 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:47.635875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-18200200-20fe-4ba4-8fe5-991e49690a00 req-13ac0aae-c5cb-4792-8dee-79992dce94b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:47.649998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-18200200-20fe-4ba4-8fe5-991e49690a00 req-13ac0aae-c5cb-4792-8dee-79992dce94b9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:47.651045 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-18200200-20fe-4ba4-8fe5-991e49690a00 req-13ac0aae-c5cb-4792-8dee-79992dce94b9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:47.669150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-18200200-20fe-4ba4-8fe5-991e49690a00 req-13ac0aae-c5cb-4792-8dee-79992dce94b9 service nova] Creating event network-changed:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:20:47.676234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-18200200-20fe-4ba4-8fe5-991e49690a00 req-13ac0aae-c5cb-4792-8dee-79992dce94b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044476 Jul 14 11:20:47.676748 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 237/504] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:47.766563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:47.776274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e188ae82-bc4d-4de1-acbd-a0558b306fec tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.209821 Jul 14 11:20:47.776870 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 268/505] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:47 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:48.474115 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:48.476483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:48.484767 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.484767 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.485796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.486481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.639328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:48.640141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:48.646927 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.648177 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.648426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.649066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.928099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:48.941514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f79e9ac6-26ea-4960-971f-cf34aedc56fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.305656 Jul 14 11:20:48.942619 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 269/506] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:48 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:48.951184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:48.952311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:48.961425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.962986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:48.964529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:48.965231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:49.042937 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:49.056618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-24dd3c7f-ab8a-46cc-80bc-a037a3201cb1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.588007 Jul 14 11:20:49.069265 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 238/507] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:48 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:49.161332 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:49.168897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2ebb0ae5-ca02-4ac1-a233-60d206b92c8a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.223352 Jul 14 11:20:49.169454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 270/508] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:48 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:49.958933 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:49.959723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:49.966678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:49.967101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:49.967920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:49.968362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:50.074082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:50.075364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:50.082299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:50.082817 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:50.083696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:50.084138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:50.130351 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:50.139598 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2af44fcd-49e6-48a0-8049-5552d2003820 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.184044 Jul 14 11:20:50.140459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 239/509] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:49 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:50.187054 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:50.187782 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:50.194704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:50.195575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:50.196472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:50.196979 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:50.243767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:50.252474 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-de8908a9-79b9-4d90-b325-702bbd23ad4e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.182405 Jul 14 11:20:50.253539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 271/510] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:50 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:50.349467 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:50.357230 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8c722753-9c83-4249-8134-89b68c83ea4a tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.175150 Jul 14 11:20:50.358399 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 240/511] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:50 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:51.163631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:51.163631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:51.173618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.174579 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.175750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.176502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.281336 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:51.281969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:51.292940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.293400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.294225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.294768 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.376797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:51.387049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dc2294d2-c868-4457-ae98-d3cc1b3b7227 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.233707 Jul 14 11:20:51.388350 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 272/512] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:51 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:51.394623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:51.395500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:51.402308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.403097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.404141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.404941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.510381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:51.524718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-222dca43-b661-4303-a0bd-4474ddf2c691 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1315 microversion: 2.1 time: 0.253021 Jul 14 11:20:51.525428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 241/513] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:51 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:51.584352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:51.596577 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-55f08c5e-3301-4745-a522-c53cbe268ee6 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.205758 Jul 14 11:20:51.597608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 273/514] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:51 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:51.964698 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-c397a2db-2dd2-4859-834d-77ded238fd21 req-2fb3610b-f0e6-4f97-a0c5-a5188c5b0712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2", "name": "network-vif-plugged", "status": "completed", "tag": "4b6c8e7f-12ba-40ff-be49-a22f4f2ee1b2"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:51.979997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c397a2db-2dd2-4859-834d-77ded238fd21 req-2fb3610b-f0e6-4f97-a0c5-a5188c5b0712 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:51.980830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c397a2db-2dd2-4859-834d-77ded238fd21 req-2fb3610b-f0e6-4f97-a0c5-a5188c5b0712 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:51.996808 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-c397a2db-2dd2-4859-834d-77ded238fd21 req-2fb3610b-f0e6-4f97-a0c5-a5188c5b0712 service nova] Creating event network-vif-plugged:4b6c8e7f-12ba-40ff-be49-a22f4f2ee1b2 for instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 on hv-cinder-82282 Jul 14 11:20:52.003449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-c397a2db-2dd2-4859-834d-77ded238fd21 req-2fb3610b-f0e6-4f97-a0c5-a5188c5b0712 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045864 Jul 14 11:20:52.004307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 242/515] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:52.410771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:52.411590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:52.419280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.419975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.420963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.421404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.548900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:52.550508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:52.564253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.564882 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.566308 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.567107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.568007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:52.581364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-880aa18c-3195-4755-aea5-bfd5c35330aa tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.174030 Jul 14 11:20:52.582418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 274/516] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:52 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:52.623094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:52.624644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:52.631585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.632404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.633058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.633582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.744869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:52.756273 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-77159ee3-367d-46d2-bcc7-06d692567338 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1464 microversion: 2.1 time: 0.217246 Jul 14 11:20:52.766994 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 243/517] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:52 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:52.796815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:52.807032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4173474c-0414-4589-a080-9bf059a9ce1c tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.186199 Jul 14 11:20:52.807032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 275/518] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:52 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:52.819266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:52.819813 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:52.826154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.827192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.828239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:52.829031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:52.861663 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:20:53.277656 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d134225f-ee3e-409f-a6cb-e7956e26288e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "DELETE /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 204 len: 0 microversion: 2.1 time: 0.461791 Jul 14 11:20:53.278499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 244/519] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:20:52 2022] DELETE /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:20:53.287494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:53.291470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:53.295209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:53.296222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:53.297301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:53.297739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:53.439783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:53.448155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-84a7330a-c4ba-4380-a06a-8b1154140cba tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1470 microversion: 2.1 time: 0.164762 Jul 14 11:20:53.448728 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 276/520] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:53 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:53.600285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:53.600993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:53.608074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:53.608526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:53.609404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:53.609932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:53.753111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:53.764890 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9a7de9a3-784f-4fcb-9566-b123672693d4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.169181 Jul 14 11:20:53.765663 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 245/521] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:53 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:53.827866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:53.828937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:53.839873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:53.840656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:53.842022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:53.842813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:53.987319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:53.995211 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d4f59385-4f4c-436b-9c3e-74e7c17c8ce8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.172390 Jul 14 11:20:53.995787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 277/522] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:53 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:54.466348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:54.466872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:54.474274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:54.474775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:54.475585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:54.476047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:54.638456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:54.641024 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:54.647634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-84275dfa-a1ff-4c9f-b012-ac9c7e6bdb82 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1470 microversion: 2.1 time: 0.185255 Jul 14 11:20:54.648225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 246/523] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:54 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:54.782254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:54.783028 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:54.785409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:54.790447 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:54.790896 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:54.791724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:54.792160 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:54.943430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:54.951658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5f766e03-7371-4df7-a29f-6fdc530d58be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.173391 Jul 14 11:20:54.953257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 278/524] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:54 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:55.015284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:55.015908 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:55.023014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:55.023556 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:55.024321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:55.024761 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:55.177638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:55.192750 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-02181404-7d90-4113-bbde-6c1626a8599d tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.182719 Jul 14 11:20:55.193335 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 247/525] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:55 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:55.664990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:55.665800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:55.674118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:55.674559 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:55.675423 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:55.675874 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:55.824475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:55.836964 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cc47c067-c789-4323-adc6-29c4d61320d1 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1470 microversion: 2.1 time: 0.175518 Jul 14 11:20:55.839308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 279/526] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:55 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:55.972304 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:55.973301 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:55.980594 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:55.981072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:55.981855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:55.982286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:56.147615 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:56.157103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7183047f-e2cd-45c2-ac37-209c5413938b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.191512 Jul 14 11:20:56.157695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 248/527] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:55 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:56.212257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:56.212867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:56.220059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:56.220725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:56.221854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:56.222398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:56.239726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:56.371009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:56.379371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f9835b0d-228b-40fa-a90a-3b401355a5a8 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.171144 Jul 14 11:20:56.379935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 280/528] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:56 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:56.862228 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:56.863279 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:56.871618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:56.872059 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:56.872839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:56.873279 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:57.044860 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:57.058891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8e19407a-8bf6-4151-818d-966ab5a39b7e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1470 microversion: 2.1 time: 0.204154 Jul 14 11:20:57.060151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 249/529] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:56 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:57.175622 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:57.176170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:57.183291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:57.183753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:57.184544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:57.184988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:57.332507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:57.340748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-37dd9602-ac86-433e-8ecc-fcb685369338 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.169844 Jul 14 11:20:57.341362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 281/530] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:57 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:20:57.397753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:57.398452 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:57.405342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:57.407068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:57.408115 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:57.408592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:57.557615 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:57.565793 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f6580abf-a8ad-449e-8cc7-a0b05bc0625b tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.172315 Jul 14 11:20:57.566439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 250/531] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:57 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:58.088098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:58.088741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:58.099413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.100201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.101625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.102198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.261940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:58.274541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-38c3b9b8-7845-4f3b-9c5a-fdf11eaa8285 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1470 microversion: 2.1 time: 0.192900 Jul 14 11:20:58.275512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 282/532] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:58 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:58.360916 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:58.361829 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:58.371528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.372555 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.373814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.375053 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.527979 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:58.538847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1c60b9c0-9468-4cb3-8a95-66f6fb93852d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.183839 Jul 14 11:20:58.547081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 251/533] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:58 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:58.584502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:58.585123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:58.597355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.598021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.600328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.600328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.786189 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:58.799793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-762afc00-a384-4812-bf0e-06ad77754c51 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.219421 Jul 14 11:20:58.800389 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 283/534] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:58 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:58.934609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-d70f7733-6007-4abe-8a81-e1c076565dec req-9fdc2953-61b5-46c2-96db-654f4a53d82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e936032b-9d29-4116-8978-99d36831ffd8", "name": "network-vif-plugged", "status": "completed", "tag": "63958558-7b66-40b7-80b2-428eca7c1303"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:20:58.944252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-d70f7733-6007-4abe-8a81-e1c076565dec req-9fdc2953-61b5-46c2-96db-654f4a53d82f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:58.944252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-d70f7733-6007-4abe-8a81-e1c076565dec req-9fdc2953-61b5-46c2-96db-654f4a53d82f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:58.957466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-d70f7733-6007-4abe-8a81-e1c076565dec req-9fdc2953-61b5-46c2-96db-654f4a53d82f service nova] Creating event network-vif-plugged:63958558-7b66-40b7-80b2-428eca7c1303 for instance e936032b-9d29-4116-8978-99d36831ffd8 on hv-cinder-82282 Jul 14 11:20:58.962628 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-d70f7733-6007-4abe-8a81-e1c076565dec req-9fdc2953-61b5-46c2-96db-654f4a53d82f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031886 Jul 14 11:20:58.963314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 252/535] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:20:59.293434 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:59.294109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:59.301741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.302183 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.305752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.305752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.395702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:59.396276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:59.402683 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.403178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.403922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.404357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.429960 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-415a0b27-5ac5-4f6d-be4e-65f4368f0ce9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/ips" status: 200 len: 153 microversion: 2.20 time: 0.038868 Jul 14 11:20:59.430919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 253/536] 10.222.0.59 () {60 vars in 1288 bytes} [Thu Jul 14 11:20:59 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:20:59.449654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:59.459110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-689fb707-9987-4115-9126-39eea00b67bc tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1470 microversion: 2.1 time: 0.169793 Jul 14 11:20:59.459702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 284/537] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:59 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:59.561330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:59.562738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:59.569867 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.570507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.571800 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.572382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.754662 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:20:59.768963 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f6b9025f-58ed-4e7b-943e-fa2cfe8bf60d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.211035 Jul 14 11:20:59.783943 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 254/538] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:59 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:20:59.820910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:20:59.822188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:20:59.842858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.843770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:20:59.844561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:20:59.844998 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:00.091779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:00.100186 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-17b959cd-a6ee-44fd-a4b8-0b1cc04a51b0 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.284333 Jul 14 11:21:00.101189 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 285/539] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:20:59 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:00.480656 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:00.482284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:00.492774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:00.493266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:00.494088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:00.496129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:00.573568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-78c7a9d7-da6e-4c1e-b17b-a6c10b058e91 req-34e09a06-c003-4377-884f-2ab8c75ceb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ec1d2d-99c0-41e3-a22a-08c1f71734f6", "name": "network-vif-deleted", "tag": "8f82a134-7a70-4f7b-9602-3c901f83fc0c"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:00.593792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-78c7a9d7-da6e-4c1e-b17b-a6c10b058e91 req-34e09a06-c003-4377-884f-2ab8c75ceb46 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:00.596718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-78c7a9d7-da6e-4c1e-b17b-a6c10b058e91 req-34e09a06-c003-4377-884f-2ab8c75ceb46 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:00.631205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-78c7a9d7-da6e-4c1e-b17b-a6c10b058e91 req-34e09a06-c003-4377-884f-2ab8c75ceb46 service nova] Creating event network-vif-deleted:8f82a134-7a70-4f7b-9602-3c901f83fc0c for instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 on hv-cinder-82282 Jul 14 11:21:00.632864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:00.644982 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-78c7a9d7-da6e-4c1e-b17b-a6c10b058e91 req-34e09a06-c003-4377-884f-2ab8c75ceb46 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075025 Jul 14 11:21:00.646457 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 286/540] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:21:00.654325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b4885c30-a1e1-4971-829b-8778f0ac2f09 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1428 microversion: 2.1 time: 0.179228 Jul 14 11:21:00.659468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 255/541] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:00 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:00.794209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:00.794969 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:00.805417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:00.806764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:00.807618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:00.808383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:00.970295 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:00.979935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cc706c8f-db98-41c5-8209-58d12c43705f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1319 microversion: 2.1 time: 0.192348 Jul 14 11:21:00.994855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 287/542] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:00 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:01.118676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:01.119280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:01.126387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:01.126848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:01.127697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:01.128140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:01.307537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:01.323307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-64f901cd-b2c0-4fa7-8adf-779c24ba76da tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.208169 Jul 14 11:21:01.339461 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 256/543] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:01 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:01.674805 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:01.675418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:01.682010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:01.682440 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:01.683245 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:01.683686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:01.748572 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:01.756856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5d4f98f0-1fb8-442b-ad76-71edbfe8f40b tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1300 microversion: 2.1 time: 0.085945 Jul 14 11:21:01.757427 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 288/544] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:01 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:01.999092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:02.000788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:02.009499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.010370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.011733 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.012181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.168305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:02.177221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ffdc97d1-e79d-45c3-ad4e-8d9ac0c71980 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1506 microversion: 2.1 time: 0.183071 Jul 14 11:21:02.177953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 257/545] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:01 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:02.350616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:02.351360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:02.357906 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.358351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.359155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.360264 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.535177 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:02.544750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fe4620fc-c44e-4ee7-8798-f201614af8e3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.198351 Jul 14 11:21:02.545335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 289/546] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:02 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:02.776476 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:02.777252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:02.785302 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.785658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.786432 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.786864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.825186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:02.825619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:02.826085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lazy-loading 'fault' on Instance uuid 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:21:02.885756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:02.910144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0121c197-aa44-469a-bf71-d92e1864d2a4 tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1305 microversion: 2.1 time: 0.137883 Jul 14 11:21:02.910916 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 258/547] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:02 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:03.049617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:03.050378 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:03.058388 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.059103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.060007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.060443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.101037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lazy-loading 'flavor' on Instance uuid a91745f1-a0c6-47f3-8c7b-da031d0dc625 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:21:03.570862 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:03.571766 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:03.579346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.579913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.580919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.581592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.832280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:03.841565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4fdcd075-d0d3-4524-9fd3-4c9cb01ab3b9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1313 microversion: 2.1 time: 0.279753 Jul 14 11:21:03.842158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 259/548] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:03 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:03.929184 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:03.929817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:03.936902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.937357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.938550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.939262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.974599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:03.975291 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:03.975984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lazy-loading 'fault' on Instance uuid 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:21:04.032978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e0f11ca7-5f00-42e7-8f9f-fabef1375d5e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/action" status: 202 len: 0 microversion: 2.20 time: 0.987502 Jul 14 11:21:04.034126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 290/549] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jul 14 11:21:03 2022] POST /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/action => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:21:04.044340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5a5aa9ccde4aa0ac0362b11010f5c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff6b9f656b24b4a8b5724f9a0078b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:04.048285 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:04.049455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:04.057510 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4439233d-8984-4c99-b88e-965e3c25701e tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 200 len: 1305 microversion: 2.1 time: 0.132103 Jul 14 11:21:04.058734 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 260/550] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:03 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:04.060974 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:04.061790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:04.063681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:04.064484 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:04.271036 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:04.284659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:04.286499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:04.287847 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c59916d2-ec03-4e55-86c4-32ce893189f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.248120 Jul 14 11:21:04.288303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 291/551] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:04 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:04.863217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:04.864335 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:04.871754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:04.872202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:04.872996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:04.873550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:05.033014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:05.043780 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-212ca495-85d2-4910-a090-c0b2cc782db5 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1497 microversion: 2.1 time: 0.188226 Jul 14 11:21:05.044393 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 261/552] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:04 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:05.088480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:05.089618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] [instance: 26ec1d2d-99c0-41e3-a22a-08c1f71734f6] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:05.102589 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:05.103547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:05.105143 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:05.106207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:05.132807 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] HTTP exception thrown: Instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 could not be found. Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Request method failure captured: Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 HTTP/1.1 Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_v4NomUA1oXxcKd_U-2_RIVaCQCxLloGD6y-VqZPhDqsgEEMAZ3OPzYHL0xiCHpljzy7joUHbtBEYlqr6fJr0LrjTFWFiKBZ6x0eWaN52OwfcJvkZu7bNzKSqJJtrHutTKeg_BKnX-T-DQh6F2UPSnS2UCRd2zZgrAYIAEIBl47N9A Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: fff6b9f656b24b4a8b5724f9a0078b2f Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesNegativeTest-1648716484 Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:21:05.135750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fff6b9f656b24b4a8b5724f9a0078b2f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fff6b9f656b24b4a8b5724f9a0078b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fff6b9f656b24b4a8b5724f9a0078b2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fff6b9f656b24b4a8b5724f9a0078b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesNegativeTest-1648716484 Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: fff6b9f656b24b4a8b5724f9a0078b2f Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesNegativeTest-1648716484 Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesNegativeTest-1648716484-project Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 6a5a5aa9ccde4aa0ac0362b11010f5c0 Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesNegativeTest-1648716484-project Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 could not be found. Jul 14 11:21:05.137453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '26ec1d2d-99c0-41e3-a22a-08c1f71734f6'} Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 could not be found. Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:21:05.138454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 could not be found. Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 could not be found. Jul 14 11:21:05.139903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:21:05.145284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] Returning 404 to user: Instance 26ec1d2d-99c0-41e3-a22a-08c1f71734f6 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:21:05.145284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fe41d594-08ed-4947-a780-2e4a36e01c6a tempest-VolumesNegativeTest-1648716484 tempest-VolumesNegativeTest-1648716484-project] 10.222.0.59 "GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6" status: 404 len: 111 microversion: 2.1 time: 0.057594 Jul 14 11:21:05.145284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 292/553] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:05 2022] GET /compute/v2.1/servers/26ec1d2d-99c0-41e3-a22a-08c1f71734f6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:21:05.325078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:05.325078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:05.332436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:05.333219 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:05.334564 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:05.335362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:05.546994 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:05.557119 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:05.558639 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:05.559847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-692c77fd-c17f-4b84-ae7f-ce0f5045e1ea tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.250371 Jul 14 11:21:05.560518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 262/554] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:05 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:06.586585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:06.587760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:06.599228 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:06.599733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:06.600592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:06.601139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:06.652468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:06.654937 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:06.665730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:06.666547 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:06.667824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:06.668270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:06.708629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:21:06.710718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:06.826130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:06.842629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:06.846118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:06.863203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2a2cc293-7ad0-43c3-b65f-d6070aecbb35 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.268569 Jul 14 11:21:06.863203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 293/555] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:06 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:06.995694 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:07.131673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-eca9b0a3-28bc-495a-b086-be6243475e04 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 204 len: 0 microversion: 2.1 time: 0.484289 Jul 14 11:21:07.132732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 263/556] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:21:06 2022] DELETE /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:21:07.144376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:07.161063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:07.161063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:07.161063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:07.161063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:07.161707 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:07.351960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:07.365835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0cf4dfc0-de55-4e7f-ac27-cc959745e703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1503 microversion: 2.1 time: 0.226710 Jul 14 11:21:07.369608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 294/557] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:07 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:07.878308 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:07.879534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:07.889627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:07.889627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:07.889627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:07.889627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:08.080329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:08.091182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:08.092625 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:08.093918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-78882a9e-24d2-43f6-ac09-4ef0766e841c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.228686 Jul 14 11:21:08.094685 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 264/558] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:07 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:08.387565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:08.388494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:08.398517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:08.398517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:08.400144 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:08.400633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:08.619950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:08.633409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c4ed33cf-612d-4dbd-87d6-72a4d69adff9 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1503 microversion: 2.1 time: 0.249514 Jul 14 11:21:08.634391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 295/559] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:08 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:09.118047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:09.118882 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:09.129414 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:09.129948 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:09.131676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:09.132226 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:09.384316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:09.389946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:09.393682 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:09.396210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a316522d-f6a7-45b0-82e5-ad1f4e566694 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.281655 Jul 14 11:21:09.397391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 265/560] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:09 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:09.660300 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:09.661723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:09.669337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:09.669790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:09.670563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:09.670994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:09.690111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:09.860406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:09.870631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8e85cba4-3d13-4a85-a5c9-b19f70c0f195 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1503 microversion: 2.1 time: 0.215474 Jul 14 11:21:09.871241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 296/561] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:09 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:10.431826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:10.433519 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:10.452646 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:10.456194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:10.457480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:10.458123 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:10.655410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:10.666463 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:10.668311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:10.669883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-06955dc9-f474-46f8-ac33-b7986c8bc537 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.245750 Jul 14 11:21:10.672143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 266/562] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:10 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:10.820565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-02bd0f5b-36fa-48a5-850a-8e85e5212272 req-bbaac447-6385-4d3c-868e-bdf4170f28a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e936032b-9d29-4116-8978-99d36831ffd8", "name": "network-vif-deleted", "tag": "63958558-7b66-40b7-80b2-428eca7c1303"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:10.834135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-02bd0f5b-36fa-48a5-850a-8e85e5212272 req-bbaac447-6385-4d3c-868e-bdf4170f28a6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:10.834680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-02bd0f5b-36fa-48a5-850a-8e85e5212272 req-bbaac447-6385-4d3c-868e-bdf4170f28a6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:10.852311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-02bd0f5b-36fa-48a5-850a-8e85e5212272 req-bbaac447-6385-4d3c-868e-bdf4170f28a6 service nova] Creating event network-vif-deleted:63958558-7b66-40b7-80b2-428eca7c1303 for instance e936032b-9d29-4116-8978-99d36831ffd8 on hv-cinder-82282 Jul 14 11:21:10.858563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-02bd0f5b-36fa-48a5-850a-8e85e5212272 req-bbaac447-6385-4d3c-868e-bdf4170f28a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042866 Jul 14 11:21:10.859670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 297/563] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:21:10.891930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:10.893227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:10.899631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:10.900335 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:10.901129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:10.901570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:10.988974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:10.997100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-08b6b549-1f90-4308-a6f1-d277ec7263a1 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1461 microversion: 2.1 time: 0.110426 Jul 14 11:21:10.997969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 267/564] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:10 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1461 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:21:11.695723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:11.696529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:11.704431 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:11.704956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:11.706205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:11.706824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:11.907560 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:11.921324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:11.923875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:11.925348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-53602e51-8ccc-49fd-8116-0a6340696224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.236661 Jul 14 11:21:11.925942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 298/565] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:11 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:12.015945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:12.016702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:12.024022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.024521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:12.025663 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.025968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:12.088428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.089371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:12.090154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lazy-loading 'fault' on Instance uuid e936032b-9d29-4116-8978-99d36831ffd8 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:21:12.161137 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162160bbb86e40c9bb957a213034e25f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d33745da9045b989026dad3b5b7abb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:12.169894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b1c248a5-4feb-4ac1-8922-9b7749d3eaa3 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 200 len: 1303 microversion: 2.1 time: 0.157717 Jul 14 11:21:12.178484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 268/566] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:12 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:21:12.948278 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:12.949059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:12.955816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.956273 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:12.957224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:12.957662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:13.170602 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:13.192934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:13.194475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:13.196436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0291a201-addd-4c56-9e67-32b45338f5a7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.252181 Jul 14 11:21:13.215319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 299/567] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:12 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:13.215754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:13.215754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] [instance: e936032b-9d29-4116-8978-99d36831ffd8] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:13.215754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:13.215754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:13.216817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:13.216817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:13.237124 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] HTTP exception thrown: Instance e936032b-9d29-4116-8978-99d36831ffd8 could not be found. Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Request method failure captured: Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 HTTP/1.1 Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_urQ5Y6nTf5RUa9BhJHUye7w21qE38oz3PIO0NrNVnqmXbVNhfnn2yd1AalV6P71YAifC4aH3BOpLcx4dL-V-DQYRe2ICwrZ7pJGJaKpokab-G0Hdc017vor_K741OpSc0_7v-Vyzsqmjvzooens1SEGXuL95lzP9CY2AkUypQpM0I Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 76d33745da9045b989026dad3b5b7abb Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-VolumesActionsTest-878374332 Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:21:13.238817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_76d33745da9045b989026dad3b5b7abb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/76d33745da9045b989026dad3b5b7abb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76d33745da9045b989026dad3b5b7abb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/76d33745da9045b989026dad3b5b7abb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-VolumesActionsTest-878374332 Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 76d33745da9045b989026dad3b5b7abb Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-VolumesActionsTest-878374332 Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-VolumesActionsTest-878374332-project Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 162160bbb86e40c9bb957a213034e25f Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-VolumesActionsTest-878374332-project Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance e936032b-9d29-4116-8978-99d36831ffd8 could not be found. Jul 14 11:21:13.241152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': 'e936032b-9d29-4116-8978-99d36831ffd8'} Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e936032b-9d29-4116-8978-99d36831ffd8 could not be found. Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:21:13.242112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e936032b-9d29-4116-8978-99d36831ffd8 could not be found. Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e936032b-9d29-4116-8978-99d36831ffd8 could not be found. Jul 14 11:21:13.244346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:21:13.246858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] Returning 404 to user: Instance e936032b-9d29-4116-8978-99d36831ffd8 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:21:13.246858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cb3b76b3-2327-4cf5-8b35-7d9f70399703 tempest-VolumesActionsTest-878374332 tempest-VolumesActionsTest-878374332-project] 10.222.0.59 "GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8" status: 404 len: 111 microversion: 2.1 time: 0.053773 Jul 14 11:21:13.246858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 269/568] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:21:13 2022] GET /compute/v2.1/servers/e936032b-9d29-4116-8978-99d36831ffd8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:21:14.234133 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:14.235502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:14.248644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:14.249730 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:14.255897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:14.255897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:14.425876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:14.440572 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:14.443865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:14.445158 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-21f083a3-a6b8-419b-8ef6-e041892bb83d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.220136 Jul 14 11:21:14.458804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 300/569] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:14 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:15.467841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:15.468827 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:15.476703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:15.477169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:15.477972 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:15.478872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:15.662581 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:15.677422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:15.679471 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:15.680930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d0d5294a-3ab8-4bb6-80fe-acfc1c18f892 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.217835 Jul 14 11:21:15.681621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 270/570] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:15 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:16.708161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:16.709020 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:16.718418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:16.718871 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:16.719709 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:16.720145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:16.918608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:16.928864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:16.930402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:16.931649 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-46c4e651-1065-4f2f-96c9-89549b941cd5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.231033 Jul 14 11:21:16.932218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 301/571] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:16 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:17.954487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:17.955169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:17.961963 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:17.962420 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:17.963304 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:17.963751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:18.244716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:18.259828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:18.261387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:18.262557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-453bf870-5954-4b6e-b7d3-33d19c2f3e21 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.313082 Jul 14 11:21:18.263186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 271/572] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:17 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:19.285740 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:19.286901 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:19.298293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:19.298905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:19.300956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:19.305069 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:19.469979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:19.479945 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:19.481716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:19.483157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8d2ce3ba-6909-413e-a3c0-244f34dabaa8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.205411 Jul 14 11:21:19.483861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 302/573] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:19 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:20.501540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:20.502149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:20.508891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:20.509545 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:20.510323 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:20.510759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:20.655312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:20.665873 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:20.667520 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:20.669249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-43303d40-4d94-4eaf-90f0-09999994135b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.171576 Jul 14 11:21:20.669815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 272/574] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:20 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:21.691924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:21.693709 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:21.708286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:21.708868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:21.709861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:21.710868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:21.976073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:21.992454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:21.996421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:22.001183 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-503246a1-2afe-4fee-b85b-223f278fcd97 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.316107 Jul 14 11:21:22.007996 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 303/575] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:21 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:23.027567 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:23.028239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:23.035520 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:23.035947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:23.036733 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:23.037500 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:23.201418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:23.213784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:23.220108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:23.221347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9f7b1906-8541-4cb6-a36a-f9e6ae70f144 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.197942 Jul 14 11:21:23.222851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 273/576] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:23 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:24.249289 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:24.250134 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:24.258508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:24.259395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:24.260200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:24.260645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:24.485137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:24.521758 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:24.526603 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:24.532761 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d111cca9-0334-4e0a-b27b-6d2a2378a9da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.287507 Jul 14 11:21:24.535525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 304/577] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:24 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:25.554162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:25.554894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:25.574090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:25.574610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:25.575484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:25.575934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:25.770407 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:25.779923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:25.782204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:25.783447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d4186234-dae5-4f27-95c5-56a02bb94c0f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.233814 Jul 14 11:21:25.784130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 274/578] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:25 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:26.808027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:26.808840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:26.815568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=54 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:26.820045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:26.820045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:26.820045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:26.820045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:26.989148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:27.005355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:27.008552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:27.011182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2e225e0a-c400-42ae-b4cb-662bccb6f902 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.207817 Jul 14 11:21:27.012443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 305/579] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:26 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:28.037606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:28.042152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:28.073614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:28.074187 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:28.075469 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:28.076209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:28.366416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:28.382271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:28.385614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:28.386965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-078f4569-e279-4546-9f02-dadd979983bb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.356580 Jul 14 11:21:28.387978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 275/580] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:28 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:29.429159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:29.434402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:29.460294 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:29.466797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:29.468809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:29.472178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:29.811487 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:29.857117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:29.858544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:29.865397 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-34e943a9-d30c-4110-98a0-a715505386fa tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.461266 Jul 14 11:21:29.875684 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 306/581] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:29 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:21:30.887135 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:30.887961 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:30.898446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:30.903990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:30.905240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:30.906283 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:31.239525 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:31.261970 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:31.263764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:31.265218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cf196c55-3da3-4fc2-859b-720471f3342a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.382172 Jul 14 11:21:31.265883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 276/582] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:30 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:31.877999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f4c577d0-29b4-4e69-9762-75527834dbf3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Action: 'create', calling method: .version_select at 0x7f34124ec8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-695236922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSEXjDTtnxW0a7Vss3s+75Avi7QIm+dfI0pZqykB/ajZXmPVcv6GP5gB79eNegOCyX/EV3eL0FjX/b/iO8Wtx7HGqzQehdIN1/763R0qpXFjHNxIafKvt3J6Uf1xTPhsw=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:31.919273 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-f4c577d0-29b4-4e69-9762-75527834dbf3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Getting quotas for project 81b8c45981fe4d48bf95dfbdd0804205. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:21:31.930319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-f4c577d0-29b4-4e69-9762-75527834dbf3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Getting quotas for user 6b84187a669e4849b3b9d02d8b337824 and project 81b8c45981fe4d48bf95dfbdd0804205. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:21:32.106426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f4c577d0-29b4-4e69-9762-75527834dbf3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.565816 Jul 14 11:21:32.107073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 307/583] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:21:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:32.288967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:32.291000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:32.314402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:32.314963 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:32.316130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:32.317614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:32.671155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:32.690030 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:32.693488 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:32.696838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-20dc1097-2501-40f2-89ed-914d1a656e4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.413803 Jul 14 11:21:32.698014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 277/584] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:32 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:33.723533 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:33.724482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:33.740551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:33.741702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:33.742901 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:33.743972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:34.000622 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:34.026376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:34.031289 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:34.041580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e0bc82ea-7441-4f7b-8140-db2b16325e29 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.324641 Jul 14 11:21:34.043352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 308/585] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:33 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:35.075304 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:35.076510 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:35.095635 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:35.097401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:35.098876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:35.100169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:35.339569 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:35.364876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:35.375250 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:35.380015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-46d6b3fa-dc35-4670-8392-af3609c557de tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.309229 Jul 14 11:21:35.382102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 278/586] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:35 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:36.401149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:36.402584 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:36.412909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:36.413710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:36.414858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:36.415357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:36.640047 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:36.651438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:36.653658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:36.655529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-60028d0b-2aa8-4fc1-a4be-1951fce59df4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.258455 Jul 14 11:21:36.656739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 309/587] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:36 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:37.686431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:37.687332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:37.695702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:37.696151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:37.697055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:37.701910 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:37.701910 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:37.915386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:37.924906 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:37.926627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:37.928826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-360d1abc-40ce-43d8-97f6-8cffb70af465 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.246721 Jul 14 11:21:37.929420 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 279/588] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:37 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:38.952132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:38.953275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:38.966304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:38.967565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:38.968910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:38.969963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:39.204651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:39.218653 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:39.221147 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:39.222822 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-265fbeeb-1814-45b6-95a4-c172da394ba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.277562 Jul 14 11:21:39.223857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 310/589] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:38 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:39.362043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-6eda5c24-4150-41e7-b90f-e0fa9490d32d req-8257cedb-bf1c-4362-871f-3e9840de5264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "name": "network-vif-plugged", "status": "completed", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:39.385052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:39.387693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-6eda5c24-4150-41e7-b90f-e0fa9490d32d req-8257cedb-bf1c-4362-871f-3e9840de5264 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:39.388305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-6eda5c24-4150-41e7-b90f-e0fa9490d32d req-8257cedb-bf1c-4362-871f-3e9840de5264 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:39.408523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-6eda5c24-4150-41e7-b90f-e0fa9490d32d req-8257cedb-bf1c-4362-871f-3e9840de5264 service nova] Creating event network-vif-plugged:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:21:39.415352 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-6eda5c24-4150-41e7-b90f-e0fa9490d32d req-8257cedb-bf1c-4362-871f-3e9840de5264 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057259 Jul 14 11:21:39.419699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 280/590] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:40.247580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:40.249907 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:40.265842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:40.269809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:40.275536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:40.276496 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:40.498156 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:40.521412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:40.525955 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:40.528771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-216fe12d-a750-4b97-ac86-76b2d538343c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.289356 Jul 14 11:21:40.529687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 311/591] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:40 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:41.558612 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:41.559398 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:41.566906 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:41.574585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:41.574585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:41.574585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:41.717114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:41.726113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:41.727658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:41.729082 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-27dbc81e-9804-4788-8aea-491bac879711 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.180531 Jul 14 11:21:41.729637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 281/592] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:41 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:42.748212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:42.748943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:42.751367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=4 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:42.757747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:42.758282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:42.771913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:42.771913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:42.771913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=84 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:42.943422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:42.952439 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:42.953962 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:42.955345 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1deb2261-7e5d-4104-bf2a-c8124ca659bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.210918 Jul 14 11:21:42.956190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 312/593] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:42 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:21:43.980490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:43.981501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:43.993738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:43.994214 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:43.994993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:43.995670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:44.202286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:44.212730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:44.214557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:44.215999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0854e731-128c-46e1-9c2d-c9a9823bfd2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.242634 Jul 14 11:21:44.216742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 282/594] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:43 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:45.237869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:45.239153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:45.248030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.248481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.249275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:45.249736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:45.485351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:45.501833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:45.504656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:45.506953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a375c6c5-5d15-4041-9d22-50411e0d0af6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.273384 Jul 14 11:21:45.508382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 313/595] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:45 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:21:46.476118 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ba56ec4-b080-4362-b06b-56093b6c8774", "device": "/dev/sdb"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:21:46.477876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:46.486136 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:46.486599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:46.487668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:46.488243 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:46.545011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:46.545011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:46.548263 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:46.548921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:46.550687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:46.551692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:47.107910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:47.110855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:47.112472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:47.122408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9a5d1d10-d7d1-43ec-bb50-6c8e2dfe7a36 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1745 microversion: 2.20 time: 0.591590 Jul 14 11:21:47.123550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 314/596] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:46 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1745 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:21:47.819813 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3f0561db-fa9a-4039-9a93-de0afbd6169c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "POST /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.348463 Jul 14 11:21:47.821411 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 283/597] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:21:46 2022] POST /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2/os-volume_attachments => generated 194 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:21:48.155327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:48.157137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:48.168391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.169078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.170563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:48.171555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:48.447417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:48.460175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:48.462959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:48.464998 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8322cfbf-8314-479a-97de-765a44cd0540 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.316020 Jul 14 11:21:48.465873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 315/598] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:48 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:49.488546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:49.490116 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:49.499666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:49.500834 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:49.501865 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:49.502832 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:49.727851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:49.743988 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:49.746969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:49.749965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3f0ea310-56e4-4538-8b12-bd929f5053e6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.267006 Jul 14 11:21:49.750815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 284/599] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:49 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:50.785207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:50.786455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:50.797978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:50.798935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:50.799853 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:50.800709 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:51.025832 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:51.052313 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:51.056573 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:51.059152 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9f057e53-f8ef-4ccc-a14c-1805d12f3b0d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.278294 Jul 14 11:21:51.066997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 316/600] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:50 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:52.089084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:52.089751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:52.099737 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:52.101012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:52.102373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:52.103145 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:52.294041 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:52.306848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:52.312874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:52.312874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-04156d39-393c-4627-898b-d161f77ba289 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.228081 Jul 14 11:21:52.314038 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 285/601] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:52 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:53.337810 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:53.340119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:53.351579 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:53.352047 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:53.352864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:53.353304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:53.536009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:53.552415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:53.556751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:53.559087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e97d16dc-839e-4243-87bb-fec87af4e886 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.226020 Jul 14 11:21:53.559995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 317/602] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:53 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:54.582256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:54.582935 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:54.590834 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:54.591350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:54.592171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:54.592614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:54.767788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:54.777550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:54.779114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:54.780395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2929d5e8-15de-4074-9571-b76b4c9345d0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.202302 Jul 14 11:21:54.780956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 286/603] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:54 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:55.799771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:55.800473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:55.808752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:55.809910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:55.811856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:55.812631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:55.979803 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:55.989443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:55.990984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:55.992771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8581a09e-985f-4e50-8dfa-f5c42bb271a8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.197008 Jul 14 11:21:55.993373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 318/604] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:55 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:57.020052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:57.020916 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:57.028753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:57.029210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:57.029997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:57.030432 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:57.201199 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:57.212385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:57.215161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:57.216968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-789fed1b-e9fd-4833-b06a-467163bc0e19 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.201424 Jul 14 11:21:57.222644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 287/605] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:57 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:58.237870 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:58.238524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:58.242080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:58.247790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:58.248292 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:58.249171 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:58.249608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:58.432895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:58.442165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:58.444004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:58.445962 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-39e16522-624e-445f-a906-487ee494d5bd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.211945 Jul 14 11:21:58.446742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 319/606] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:58 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:21:59.471175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:21:59.473373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:21:59.487462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:59.488618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:59.490297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:21:59.491190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:21:59.650862 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:59.659395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:59.660899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:21:59.662058 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-901d379b-45d8-48c0-b399-188565d7df25 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.199460 Jul 14 11:21:59.662618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 288/607] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:21:59 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:00.684405 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:00.685494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:00.696652 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:00.699271 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:00.702586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:00.703143 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:01.055549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:01.070467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:01.072561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:01.073715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-96694786-583b-4f12-95bf-48bd57d0ab1b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.395555 Jul 14 11:22:01.074237 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 320/608] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:00 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:02.092508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:02.093321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:02.100670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:02.101259 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:02.102076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:02.102545 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:02.341417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:02.350319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:02.352587 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:02.354227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-31827d4d-6365-4c40-af48-dc9aa6065467 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.265771 Jul 14 11:22:02.355427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 289/609] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:02 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:03.374372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:03.375035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:03.382301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.383179 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.384700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:03.385137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:03.538638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:03.548097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:03.550541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:03.551897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3ff779d4-1122-4940-914c-7e48ad1625e0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.181806 Jul 14 11:22:03.552449 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 321/610] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:03 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:04.599381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:04.607813 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:04.620887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:04.621738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:04.622894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:04.623527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:04.829469 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:04.845920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:04.848875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:04.851226 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-af942748-6215-4db5-951b-be0c5b8c511d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.281780 Jul 14 11:22:04.852743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 290/611] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:04 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:05.880078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:05.880731 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:05.891506 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:05.891956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:05.892734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:05.893170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:06.068643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:06.080112 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:06.082297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:06.084083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7af421af-dd82-41bb-a7a4-1e39a1cee136 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.210807 Jul 14 11:22:06.085202 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 322/612] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:05 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:07.113151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:07.113811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:07.122166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:07.122619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:07.123443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:07.123888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:07.256514 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:07.265239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:07.266880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:07.268068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d00e7218-d134-457e-92c9-910792b33034 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.159334 Jul 14 11:22:07.273665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 291/613] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:07 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:08.286341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:08.286999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:08.295681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.296435 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.297461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:08.298092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:08.448393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:08.457691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:08.459262 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:08.460511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d8e6ceb4-1867-470e-baac-cec7de9f7ce5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.178463 Jul 14 11:22:08.461068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 323/614] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:08 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:09.482880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:09.484527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:09.504751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:09.505451 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:09.506580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:09.507205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:09.889371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:09.899327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:09.902475 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:09.904895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7902cc08-61a4-4688-890c-a2b52b8ceede tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.426237 Jul 14 11:22:09.905572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 292/615] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:09 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:10.928585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:10.929605 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:10.949412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:10.949875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:10.950699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:10.951229 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:11.134642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:11.148258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:11.148258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:11.149097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-82207940-2e2f-4007-a174-d2bd77766210 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.224638 Jul 14 11:22:11.150599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 324/616] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:10 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:12.169786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:12.170396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:12.177566 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:12.178019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:12.178800 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:12.179270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:12.184810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:12.358838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:12.372197 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:12.375063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:12.377020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-621d5876-9011-49d1-adc4-fac8067b5eec tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.211830 Jul 14 11:22:12.400472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 293/617] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:12 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:13.407595 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:13.408229 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:13.415966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:13.416418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:13.417732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:13.417732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:13.421196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=78 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:13.578215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:13.587803 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:13.592576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:13.592576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0d69355b-0319-4b0f-947a-974015ceb1b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.186979 Jul 14 11:22:13.592576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 325/618] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:13 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:14.799019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:14.800032 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:14.802018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=28 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:14.808812 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:14.809570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:14.811092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:14.811853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:15.071237 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:15.089232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:15.092600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:15.094970 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5bf6afdc-c527-4812-bc1d-d6befc1bf6c3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.489511 Jul 14 11:22:15.096046 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 294/619] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:14 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:16.122791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:16.123660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:16.130556 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:16.131030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:16.131875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:16.132314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:16.301141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:16.310696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:16.312330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:16.313585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4c1d8c9c-dd3a-4622-8303-2bcab9ab6127 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1740 microversion: 2.20 time: 0.195719 Jul 14 11:22:16.314160 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 326/620] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:16 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:17.335078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:17.335746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:17.345769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:17.346457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:17.347755 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:17.348460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:17.552555 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:17.562377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:17.564004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:17.565776 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d497fb2f-3702-4b6e-8c73-1f3a3357d50c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.235086 Jul 14 11:22:17.567105 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 295/621] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:17 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:18.599630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:18.600552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:18.607617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:18.608374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:18.609212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:18.609654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:18.754019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:18.755234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:18.756775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:18.758012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ee038acb-54e6-4795-b5ad-74ec6476f26a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.163195 Jul 14 11:22:18.758591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 327/622] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:18 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:19.778365 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:19.778983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:19.786298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:19.786913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:19.787793 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:19.788266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:19.927360 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:19.937245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:19.939004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:19.940192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d821b4dd-fac3-47d8-b035-7005a04e2a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.166501 Jul 14 11:22:19.940925 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 296/623] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:19 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:20.959581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:20.960293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:20.967558 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:20.968014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:20.968791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:20.969266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:21.102317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:21.110727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:21.112266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:21.113444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9a8e0bd9-2021-49ee-9dd8-78aacd390abd tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.157786 Jul 14 11:22:21.113997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 328/624] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:20 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:22.131781 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:22.132330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:22.139566 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:22.140026 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:22.140815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:22.141256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:22.277639 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:22.286073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:22.287616 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:22.288786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a1fd042d-d279-4ae3-a9a5-7d6ab3106002 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.161101 Jul 14 11:22:22.289351 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 297/625] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:22 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:22.670752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-7d677660-ec47-400b-b0d9-ba681b9083e7 req-fa360d64-e235-4271-9612-d6b08a5975e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "name": "network-vif-unplugged", "status": "completed", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:22.679662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-7d677660-ec47-400b-b0d9-ba681b9083e7 req-fa360d64-e235-4271-9612-d6b08a5975e4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:22.680107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-7d677660-ec47-400b-b0d9-ba681b9083e7 req-fa360d64-e235-4271-9612-d6b08a5975e4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:22.691901 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-7d677660-ec47-400b-b0d9-ba681b9083e7 req-fa360d64-e235-4271-9612-d6b08a5975e4 service nova] Creating event network-vif-unplugged:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:22:22.697831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-7d677660-ec47-400b-b0d9-ba681b9083e7 req-fa360d64-e235-4271-9612-d6b08a5975e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030282 Jul 14 11:22:22.698443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 329/626] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:22:23.308246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:23.308868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:23.315653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:23.316128 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:23.316906 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:23.317341 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:23.461681 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:23.469771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:23.471304 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:23.472452 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-020c605d-5d61-4fc6-8132-40f2a418e9e3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.168797 Jul 14 11:22:23.473011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 298/627] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:23 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:24.492485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:24.493355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:24.501845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:24.502321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:24.503106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:24.503686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:24.726751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:24.735303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:24.736806 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:24.737971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0e67478b-7e7d-4513-9287-d3c6a17c9059 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.249847 Jul 14 11:22:24.738527 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 330/628] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:24 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:25.757117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:25.757699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:25.765403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:25.765851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:25.766629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:25.767063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:25.911210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:25.920493 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:25.922251 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:25.923457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1795ff4b-8687-45fd-b5c1-54db12d0198d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.170259 Jul 14 11:22:25.924015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 299/629] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:25 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:26.942450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:26.943109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:26.951623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:26.952115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:26.952983 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:26.953461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:27.118367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:27.127395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:27.128967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:27.130168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9177362d-011a-4379-b130-c2abfd324c06 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.191896 Jul 14 11:22:27.130733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 331/630] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:26 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:28.149020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:28.160595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:28.160595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:28.160595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:28.160595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:28.161218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:28.311824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:28.320377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:28.322097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:28.324314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-42c5a277-c179-43b7-9800-6a26fb53ca5f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1722 microversion: 2.20 time: 0.179393 Jul 14 11:22:28.324898 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 300/631] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:28 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:29.348946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:29.349836 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:29.353428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=26 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:29.360603 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:29.361103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:29.361884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:29.362329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:29.496819 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:29.497502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:29.506340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:29.506798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:29.507639 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:29.507767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:29.508076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:29.518011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:29.519561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:29.520782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ca98603f-a4e9-4c8c-b888-35e6c919e437 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1725 microversion: 2.20 time: 0.179027 Jul 14 11:22:29.521355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 332/632] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:29 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:29.542712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "946f7f33-fa0e-4046-8500-9bdd5bd525d0"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:29.543072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e9c3c060-1f7e-48db-b6b4-553305e2e63c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/ips" status: 200 len: 145 microversion: 2.1 time: 0.051461 Jul 14 11:22:29.543672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 301/633] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:22:29 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:22:29.544604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:29.552118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:29.552613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:29.553471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:29.554009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:31.371360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-66ac2b37-5878-4b80-9fcb-96a2aeb04727 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.833306 Jul 14 11:22:31.372056 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 333/634] 10.222.0.59 () {62 vars in 1363 bytes} [Thu Jul 14 11:22:29 2022] POST /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments => generated 188 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:22:31.521518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:31.522521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:31.532638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:31.533100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:31.534850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:31.535427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:31.624662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:31.625601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:31.632378 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:31.633119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:31.634008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:31.634492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:31.780054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lazy-loading 'services' on Instance uuid f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:22:32.110338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-073a36f8-c386-419f-b25a-44aca5a0c253 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/action" status: 202 len: 0 microversion: 2.20 time: 0.598788 Jul 14 11:22:32.120521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 302/635] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jul 14 11:22:31 2022] POST /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:22:32.120521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:32.121706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:32.128193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:32.128649 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:32.129436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:32.129867 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:32.262817 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f23a8272-2080-4a9e-ae07-c56b242d5ae4 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2/os-volume_attachments/4ba56ec4-b080-4362-b06b-56093b6c8774" status: 202 len: 0 microversion: 2.1 time: 0.644392 Jul 14 11:22:32.271956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 334/636] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:22:31 2022] DELETE /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2/os-volume_attachments/4ba56ec4-b080-4362-b06b-56093b6c8774 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:22:32.281900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:32.294089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:32.296452 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:32.297665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6785b942-00b4-49df-8a5e-e35fda7c5b3a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1751 microversion: 2.20 time: 0.182181 Jul 14 11:22:32.298445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 303/637] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:32 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:32.680977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-377411178", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-695236922", "security_groups": [{"name": "tempest-secgroup-smoke-188143468"}], "networks": [{"uuid": "fc6e0970-6f06-48f5-a5f1-16a07c367798"}], "block_device_mapping_v2": [{"uuid": "19d8db2a-3c99-4197-8a13-1024d0c5f9d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:32.804809 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] validate_networks() for [('fc6e0970-6f06-48f5-a5f1-16a07c367798', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:22:33.319893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:33.320732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:33.325528 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:22:33.326011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:22:33.326536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:22:33.327171 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:22:33.327797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:22:33.328917 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:33.329371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:33.330149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:33.330817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:33.341011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:33.341011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:33.341876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:33.342045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:33.365482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Getting quotas for project 81b8c45981fe4d48bf95dfbdd0804205. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:22:33.371439 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Getting quotas for user 6b84187a669e4849b3b9d02d8b337824 and project 81b8c45981fe4d48bf95dfbdd0804205. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:22:33.468296 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:22:33.473023 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19d8db2a-3c99-4197-8a13-1024d0c5f9d8',volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:22:33.564768 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:33.573707 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:33.575519 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:33.576678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-80513a31-6724-4a60-83c5-fbc1b9f6f019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1751 microversion: 2.20 time: 0.262618 Jul 14 11:22:33.578906 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 304/638] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:33 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:34.249380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-97e4f3ba-f4b3-42ea-8254-cfe2f66297b8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.572661 Jul 14 11:22:34.250186 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 335/639] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:22:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 11:22:34.264909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-93535052-3cde-43f6-9676-cea17404ced0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:34.265887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-93535052-3cde-43f6-9676-cea17404ced0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:34.331690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-93535052-3cde-43f6-9676-cea17404ced0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:34.339042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-93535052-3cde-43f6-9676-cea17404ced0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1087 microversion: 2.1 time: 0.082094 Jul 14 11:22:34.339765 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 305/640] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:34 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1087 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:34.482052 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:34.482556 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:34.490458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:34.490918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:34.491754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:34.492182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:34.518770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:22:34.578695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f01e3db2-bc18-4b5a-ac94-ac65c09b7ffe"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:34.587480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:34.587480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:34.587480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:34.587833 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:34.588269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.123517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a2fc8017-9d7e-4d5e-af43-c35592e3307b tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 204 len: 0 microversion: 2.1 time: 0.642339 Jul 14 11:22:35.123517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 336/641] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:22:34 2022] DELETE /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:22:35.130772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:35.131783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:35.140203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:35.140918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.141877 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:35.142305 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.291996 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:35.301862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:35.303403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:35.304578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a7051e9e-c653-4908-9374-373c86caf452 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1753 microversion: 2.20 time: 0.179890 Jul 14 11:22:35.305140 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 337/642] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:35 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:35.310812 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:35.318349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:35.318349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:35.318349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.319010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:35.319487 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:35.322411 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:35.475251 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:35.483099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5e32d8e7-0e57-4687-9b5a-7265bee69f05 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1512 microversion: 2.1 time: 0.176780 Jul 14 11:22:35.483719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 338/643] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:35 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:35.488741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fb5ceb40-80c1-4311-a453-2b133ef89fd3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:35.489412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fb5ceb40-80c1-4311-a453-2b133ef89fd3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:35.544669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-fb5ceb40-80c1-4311-a453-2b133ef89fd3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:35.551858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fb5ceb40-80c1-4311-a453-2b133ef89fd3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1087 microversion: 2.1 time: 0.067090 Jul 14 11:22:35.552432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 339/644] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:35 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:35.893735 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f92672de-4a0e-4195-96a1-7b15fdb2ad34 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.319109 Jul 14 11:22:35.894856 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 306/645] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:22:34 2022] POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-volume_attachments => generated 194 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:22:36.328032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:36.329606 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:36.336557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.337005 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.337891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.338324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.481083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:36.490415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:36.491951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:36.493113 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f42e7d6c-8ab1-466d-b2ec-3b5b5b4be287 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1753 microversion: 2.20 time: 0.170993 Jul 14 11:22:36.493711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 340/646] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:36 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:36.502888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:36.503553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:36.510152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.510600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.512391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.512541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.569160 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:36.569774 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:36.577594 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.578037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.578877 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:36.579358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:36.647598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:36.654555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bbe3f24f-5084-4970-8902-967d7870d6dc tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1137 microversion: 2.1 time: 0.089137 Jul 14 11:22:36.655169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 341/647] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:36 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:36.657137 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:36.665287 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c58ddf80-4802-4dc3-89a5-d66f39b0f6a1 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1512 microversion: 2.1 time: 0.167078 Jul 14 11:22:36.665950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 307/648] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:36 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:37.514412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:37.515050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:37.522045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.522500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.523441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.523826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.673023 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:37.673943 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:37.683715 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.684230 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.685193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.685630 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.685835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:37.698335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:37.710821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:37.710821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e61e2041-4f45-4d67-b864-ae05e2f974cf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1753 microversion: 2.20 time: 0.191824 Jul 14 11:22:37.710821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 342/649] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:37 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:37.710821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:37.711605 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:37.713618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.714923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.715766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:37.716280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:37.758518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:37.761708 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:37.768602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3b074590-572f-40b9-ad22-e576c29cdbb0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1129 microversion: 2.1 time: 0.100423 Jul 14 11:22:37.769973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 308/650] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:37 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1129 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:37.959206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:37.967853 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c520bfdc-033a-47c4-92eb-d550f5cbef95 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1512 microversion: 2.1 time: 0.263582 Jul 14 11:22:37.968432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 343/651] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:37 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:38.578297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-512eff9c-5b1b-470c-bd69-fb2bcfe2b974 req-16d3dab5-7b3a-4e45-92a3-d534705cf106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2", "name": "network-vif-deleted", "tag": "4b6c8e7f-12ba-40ff-be49-a22f4f2ee1b2"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:38.587148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-512eff9c-5b1b-470c-bd69-fb2bcfe2b974 req-16d3dab5-7b3a-4e45-92a3-d534705cf106 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.587596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-512eff9c-5b1b-470c-bd69-fb2bcfe2b974 req-16d3dab5-7b3a-4e45-92a3-d534705cf106 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.599484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-512eff9c-5b1b-470c-bd69-fb2bcfe2b974 req-16d3dab5-7b3a-4e45-92a3-d534705cf106 service nova] Creating event network-vif-deleted:4b6c8e7f-12ba-40ff-be49-a22f4f2ee1b2 for instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 on hv-cinder-82282 Jul 14 11:22:38.604624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-512eff9c-5b1b-470c-bd69-fb2bcfe2b974 req-16d3dab5-7b3a-4e45-92a3-d534705cf106 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098781 Jul 14 11:22:38.606017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 309/652] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:22:38.731995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:38.731995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:38.740388 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.740388 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.740879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.741322 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.794655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:38.796326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:38.802544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.803010 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.803826 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:38.804263 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:38.885801 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:38.901653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-35ac4208-cf8c-4b3e-88a5-ecb0e0fba723 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1193 microversion: 2.1 time: 0.112776 Jul 14 11:22:38.903443 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 310/653] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:38 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:38.946621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:38.960255 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:38.961626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:38.967948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0e0d6194-72ed-42ee-876e-f8a26909fa42 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.243991 Jul 14 11:22:38.969693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 344/654] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:38 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:38.997402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:38.998065 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:39.005751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.006209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.006987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.007457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.083836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:39.092458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-27c9c7f1-c90d-4833-8253-2e81e7e916cc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 200 len: 1304 microversion: 2.1 time: 0.099625 Jul 14 11:22:39.098944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 311/655] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:38 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:39.925444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:39.926063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:39.934314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.934875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.935689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:39.936127 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:39.990425 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:39.991050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:40.001069 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:40.002094 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:40.002694 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:40.003149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:40.181207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:40.194083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b3e78d16-6a99-4397-b512-84181db2d8ff tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.269054 Jul 14 11:22:40.195529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 345/656] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:39 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:40.225689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:40.227869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:40.243357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:40.248630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:40.249142 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:40.249924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:40.250357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:40.251492 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:40.255862 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:40.266621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] HTTP exception thrown: Instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 could not be found. Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Request method failure captured: Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 HTTP/1.1 Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_v21kcgjVLOac7VpjRAD4b2IPvhMK9K6_e1wc0NDHh6wGsHB49E8DMAX_THwgvIJ3KmzOXB3fE6szqgd87EH9jF5xkEtbGqg9XDTMP2kooM7moAAfVFyg_6CkgsNDK2eHhNoc8B8FbkD3qrqUYzTPJwW5A7jPkTDCWh3wL3-QMexAc Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 11215c9c5f59498c8110024722b1529c Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesSnapshotTestJSON-326903276 Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:22:40.269163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_11215c9c5f59498c8110024722b1529c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/11215c9c5f59498c8110024722b1529c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11215c9c5f59498c8110024722b1529c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11215c9c5f59498c8110024722b1529c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesSnapshotTestJSON-326903276 Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 11215c9c5f59498c8110024722b1529c Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-326903276 Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesSnapshotTestJSON-326903276-project Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: ee2e478cdbb04617b48f388a4b38bd35 Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesSnapshotTestJSON-326903276-project Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 could not be found. Jul 14 11:22:40.270823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2'} Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 could not be found. Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:22:40.271854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 could not be found. Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 could not be found. Jul 14 11:22:40.273331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:22:40.274721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c5d205ea-5210-4700-8baf-d63f8a31467d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.284050 Jul 14 11:22:40.274721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 312/657] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:39 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:40.275876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Returning 404 to user: Instance f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:22:40.284240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9dca4887-35a1-4ffd-ad3b-52865e479115 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2" status: 404 len: 111 microversion: 2.1 time: 0.058807 Jul 14 11:22:40.284240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 346/658] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:40 2022] GET /compute/v2.1/servers/f3d9788e-af70-44ea-8f1b-ca6c13c8c1f2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:22:41.059282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-b32c1173-2d55-4408-a5a3-d1b97f1758b2 req-893b11a4-270a-408d-ad99-ea9c078ff0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:41.072650 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-b32c1173-2d55-4408-a5a3-d1b97f1758b2 req-893b11a4-270a-408d-ad99-ea9c078ff0d9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:41.073103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-b32c1173-2d55-4408-a5a3-d1b97f1758b2 req-893b11a4-270a-408d-ad99-ea9c078ff0d9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:41.093622 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-b32c1173-2d55-4408-a5a3-d1b97f1758b2 req-893b11a4-270a-408d-ad99-ea9c078ff0d9 service nova] Creating event network-changed:0cba2204-9945-44b4-b7d6-bf19dc81c7cc for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c on hv-cinder-82282 Jul 14 11:22:41.099021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-b32c1173-2d55-4408-a5a3-d1b97f1758b2 req-893b11a4-270a-408d-ad99-ea9c078ff0d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045207 Jul 14 11:22:41.100271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 313/659] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:22:41.211987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:41.213341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:41.222119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:41.223200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:41.224305 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:41.225371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:41.295386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:41.299256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:41.307350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:41.308285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:41.309584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:41.310384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:41.457737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:41.466816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4d60943a-3f4e-425e-b006-3bd49e6f9989 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.259157 Jul 14 11:22:41.467775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 347/660] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:41 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:41.520960 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:41.532093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:41.533991 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:41.535164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3816418b-d53e-4890-ad92-43ec88c356c6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.248924 Jul 14 11:22:41.535902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 314/661] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:41 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:42.483999 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:42.484623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:42.491985 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:42.492754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:42.493811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:42.494362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:42.554126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:42.555442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:42.563317 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:42.564090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:42.565068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:42.565670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:42.680919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:42.692431 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1a122089-da86-4d6a-b585-263b5f536beb tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.212345 Jul 14 11:22:42.693334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 348/662] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:42 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:42.762747 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:42.771929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:42.773776 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:42.775028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e8dabc49-8427-481e-902f-d82bd4f2adbf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.224936 Jul 14 11:22:42.776256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 315/663] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:42 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:43.710116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:43.711060 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:43.712587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:43.719290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:43.723081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:43.723081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:43.723081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:43.796348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:43.797936 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:43.807035 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:43.809528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:43.812558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:43.813354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:43.900282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:43.909002 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-047b1ac5-9e7e-418f-b24f-076e2ee5ef37 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.203196 Jul 14 11:22:43.909769 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 349/664] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:43 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:43.968887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:43.977574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:43.985823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:43.985823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-af94dc64-e856-4a5d-b782-651e99c1322d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.188596 Jul 14 11:22:43.985823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 316/665] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:43 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:44.926216 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:44.926836 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:44.934208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:44.934659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:44.935480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:44.935919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:45.000901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:45.001504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:45.003495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:45.004843 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=50 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:45.009711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:45.010158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:45.010982 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:45.011444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:45.076481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:45.083995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-11a0232e-8f6c-4f96-b06d-331f3ca58349 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.161741 Jul 14 11:22:45.084563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 350/666] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:44 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:45.148140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:45.157040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:45.158661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:45.159885 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-49cac6dd-67b9-4d17-8a79-4511c5119a4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.164017 Jul 14 11:22:45.160458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 317/667] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:44 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:46.101388 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:46.102310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:46.107415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=8 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:46.117909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:46.118695 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:46.120105 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:46.128454 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:46.185199 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:46.187254 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:46.199310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:46.202728 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:46.212216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:46.213426 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:46.332890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:46.345310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3c1a8fab-91e1-4514-956c-9cd276fe0081 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.247786 Jul 14 11:22:46.346462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 351/668] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:46 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:46.399418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:46.411526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:46.413117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:46.414322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-66a13071-349e-4e22-a51a-e66f46106566 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.238786 Jul 14 11:22:46.414903 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 318/669] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:46 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:47.365257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:47.365891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:47.374220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:47.374667 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:47.375577 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:47.376062 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:47.433462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:47.434734 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:47.441401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:47.441850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:47.442624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:47.443063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:47.515855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:47.523233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-add82af6-c94d-422c-92d5-2d90a1e2b7f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.163867 Jul 14 11:22:47.523808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 352/670] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:47 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:47.582946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:47.591576 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:47.593098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:47.594265 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0560f2bb-d0d4-47a6-ac2f-8846cbafe43e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.164750 Jul 14 11:22:47.594828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 319/671] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:47 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:48.547033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:48.547756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:48.554380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:48.554880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:48.555676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:48.556111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:48.613333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:48.614542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:48.621577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:48.622270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:48.623337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:48.623769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:48.712239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:48.722070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4264b95c-83b4-4a8c-a3cc-5ba0e14ed407 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.179525 Jul 14 11:22:48.732668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 353/672] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:48 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:48.791327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:48.795003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:48.796593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:48.797851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-82ccc73a-c9a8-483a-a717-9878e8580b76 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.188782 Jul 14 11:22:48.798359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 320/673] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:48 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:49.740576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:49.741923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:49.748938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:49.749383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:49.750153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:49.750576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:49.818809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:49.819455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:49.840685 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:49.842271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:49.843327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:49.843928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:49.972732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:49.987340 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-37993410-7b81-446b-8bc2-b3c5f1bdcc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.250693 Jul 14 11:22:49.990331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 354/674] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:49 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:50.039563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:50.049646 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:50.054953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:50.059348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ab4cce20-3d19-43d8-892c-1ce674e4000d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.242510 Jul 14 11:22:50.059348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 321/675] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:49 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:51.004813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:51.005795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:51.014043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:51.014500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:51.015331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:51.015777 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:51.078645 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:51.079637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:51.088206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:51.088756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:51.089727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:51.090375 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:51.180856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:51.191899 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-421bcaa3-2e73-479e-9852-53d1e0694980 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.191049 Jul 14 11:22:51.193357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 355/676] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:50 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:51.267132 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:51.276073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:51.278532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:51.279722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9e134a88-7c74-41fa-aba1-8e5da6fb7d5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.206707 Jul 14 11:22:51.280708 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 322/677] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:51 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:52.210710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:52.212126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:52.219288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:52.220085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:52.221760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:52.222428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:52.258383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:52.297895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:52.299874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:52.309710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:52.310538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:52.311533 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:52.312139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:52.407272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:52.415842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2b0f5ceb-6e57-46e7-a511-69b5ee694c87 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.208915 Jul 14 11:22:52.416411 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 356/678] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:52 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:52.501922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:52.515741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:52.518358 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:52.521450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8cd41fbb-f71a-475b-96c0-6fbe553bee55 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.225955 Jul 14 11:22:52.521450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 323/679] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:52 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:53.436690 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:53.437415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:53.444499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:53.444988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:53.445860 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:53.446341 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:53.544148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:53.544148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:53.548117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:53.548584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:53.549384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:53.549823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:53.627893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:53.631291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-789f62f4-80d8-482a-a5cf-031b1c2190c7 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.201756 Jul 14 11:22:53.632050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 357/680] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:53 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:53.720413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:53.729297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:53.730821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:53.732704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8e73a46d-82bf-4daf-b967-724df6a89bca tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.198103 Jul 14 11:22:53.733286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 324/681] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:53 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:54.647986 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:54.648596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:54.655489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:54.655984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:54.656696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:54.657125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:54.751950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:54.752551 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:54.759280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:54.759891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:54.760631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:54.761064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:54.904130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:54.913410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:54.914996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:54.916399 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-add45f52-639e-483d-8077-6e23c94a0682 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.168299 Jul 14 11:22:54.920792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 325/682] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:54 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:22:55.039355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:55.047718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7b0692bc-874a-42f4-a7f7-8cd50fed1604 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.403658 Jul 14 11:22:55.048280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 358/683] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:54 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:55.936801 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:55.937408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:55.944332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:55.944785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:55.945570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:55.946017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:56.065058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:56.065767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:56.073111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:56.073573 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:56.074361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:56.074801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:56.083381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:56.085573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:56.093188 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:56.100756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:56.100756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0b58a200-5402-4115-aae6-3c471d3bc687 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.163908 Jul 14 11:22:56.100756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 326/684] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:55 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:56.213266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:56.220987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-39ee3876-254e-4707-a45b-5949b8f81d1f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.159760 Jul 14 11:22:56.221581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 359/685] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:56 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:57.114238 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:57.114823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:57.122429 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:57.122879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:57.123689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:57.124128 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:57.238049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:57.238674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:57.245373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:57.245818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:57.246602 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:57.247111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:57.261015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:57.270428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:57.271953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:57.273192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2d7e9b2b-cd37-4ebd-a916-577c68eb1ef6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.163190 Jul 14 11:22:57.273690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 327/686] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:57 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:57.384884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:57.393683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e33dc234-6a00-4d72-a79e-04ff73673725 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.159662 Jul 14 11:22:57.394269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 360/687] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:57 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:22:58.292282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:58.292889 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:58.300072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:58.300548 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:58.303673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:58.303673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:58.411281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:58.411876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:58.420092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:58.420549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:58.421736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:58.422468 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:58.476662 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:58.488896 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:58.491085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:58.492495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-19a04060-5e0c-48cc-8ed2-8194e3a84e8f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.204183 Jul 14 11:22:58.493195 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 328/688] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:58 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:58.573880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:58.582465 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f79c9a80-c13a-4b69-a7e7-1271a7ce065f tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.175019 Jul 14 11:22:58.583036 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 361/689] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:58 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:22:59.511872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:59.512549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:59.519836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:59.520315 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:59.521120 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:59.521560 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:59.581451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-381746930", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "networks": [{"uuid": "c41b0fb2-58cf-4c60-9ffd-8bd4aceb700e"}]}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:22:59.588484 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:59.636613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] validate_networks() for [('c41b0fb2-58cf-4c60-9ffd-8bd4aceb700e', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:22:59.658932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:59.667595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:59.669134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:59.670459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c19c2752-615c-4aea-ae93-0d4787cda290 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.162600 Jul 14 11:22:59.671026 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 329/690] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:22:59 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:22:59.675883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:22:59.676501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:22:59.682947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:59.683434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:59.684226 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:22:59.685344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:22:59.826865 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:22:59.831180 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-28f2a772-2e9b-453c-b07e-74ddd3155936 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.159012 Jul 14 11:22:59.831850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 330/691] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:22:59 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:00.001340 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:23:00.001793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:23:00.002267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:23:00.002676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:23:00.003087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:23:00.012097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:00.012541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:00.014204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:00.014542 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:00.032043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Getting quotas for project 11215c9c5f59498c8110024722b1529c. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:23:00.036157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Getting quotas for user ee2e478cdbb04617b48f388a4b38bd35 and project 11215c9c5f59498c8110024722b1529c. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:23:00.047873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:23:00.050141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:23:00.193656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ffcdbbb6-ed48-49fc-8333-d83e8e08bd3e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615778 Jul 14 11:23:00.194312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 362/692] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:23:00.205337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7c0d06c6-afd1-48d6-b3c4-463d2c5544ef tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:00.206045 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7c0d06c6-afd1-48d6-b3c4-463d2c5544ef tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:00.268727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7c0d06c6-afd1-48d6-b3c4-463d2c5544ef tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:00.274884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7c0d06c6-afd1-48d6-b3c4-463d2c5544ef tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1218 microversion: 2.1 time: 0.074371 Jul 14 11:23:00.275530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 331/693] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:00 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:00.690876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:00.691539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:00.698016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:00.698468 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:00.699285 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:00.699748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:00.848805 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:00.850899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:00.857727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:00.858180 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:00.858993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:00.859495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:00.875153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:00.889831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:00.892603 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:00.894692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-54dab648-69dd-4c52-a3f1-731029bb759e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.208869 Jul 14 11:23:00.895621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 363/694] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:00 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:01.033272 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:01.040900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e8fbb957-952a-4ed9-96f6-948c0f4605de tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.196130 Jul 14 11:23:01.041396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 332/695] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:00 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:01.294131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:01.295071 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:01.302658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:01.303063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:01.304244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:01.304369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:01.388437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:01.398184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ccf4a9c3-3caf-4495-a912-954f70f2e699 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1222 microversion: 2.1 time: 0.108746 Jul 14 11:23:01.398764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 364/696] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:01 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:01.920370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:01.920965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:01.927599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:01.928043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:01.928811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:01.929242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:02.057863 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:02.058565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:02.065651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:02.066002 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:02.066777 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:02.067241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:02.072409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:02.081955 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:02.083602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:02.084850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b08ab4d8-a929-46b9-a143-c410580fc757 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.168610 Jul 14 11:23:02.085494 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 333/697] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:01 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:02.210954 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:02.218609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bd3a50d0-105e-4e68-928f-15230b96de5a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.164601 Jul 14 11:23:02.219216 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 365/698] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:02 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:02.416759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:02.417341 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:02.424667 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:02.438417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:02.438417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:02.438417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:02.495411 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:02.504920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7ff483fd-71b4-4b55-9bbc-2467928f90dc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1270 microversion: 2.1 time: 0.092191 Jul 14 11:23:02.505479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 334/699] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:02 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:02.725811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9ab4ae60-fd94-4ec4-b5f5-282918e16a41 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:02.733604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9ab4ae60-fd94-4ec4-b5f5-282918e16a41 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:02.734125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9ab4ae60-fd94-4ec4-b5f5-282918e16a41 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:02.800081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9ab4ae60-fd94-4ec4-b5f5-282918e16a41 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Going to try to stop instance {{(pid=118245) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:23:03.011779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9ab4ae60-fd94-4ec4-b5f5-282918e16a41 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action" status: 202 len: 0 microversion: 2.1 time: 0.289486 Jul 14 11:23:03.012629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 366/700] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:23:02 2022] POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:23:03.020976 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:03.021784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:03.029654 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.030396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.031243 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.031841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.106838 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:03.108970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:03.120100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.121267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.122826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.123722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.189574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:03.200892 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e3f1fb8d-3de9-485d-8492-3f0de00482e3 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.183361 Jul 14 11:23:03.202159 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 335/701] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:03 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:03.238374 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:03.239343 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:03.247166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.247691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.248828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.249271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.321823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:03.336816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:03.341830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:03.344241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1bcbd58c-f1d4-4339-9196-5dac3a0dc2c9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.243792 Jul 14 11:23:03.345112 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 367/702] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:03 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:03.438631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:03.446549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-729aa748-1bf8-4cd6-b72d-87923a2f36f2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1270 microversion: 2.1 time: 0.213224 Jul 14 11:23:03.447202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 336/703] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:03 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:03.527268 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:03.528111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:03.538946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.539677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.541681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:03.541681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:03.633541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:03.642153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c37ddd0f-e5eb-4cd8-924c-415db0709108 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1276 microversion: 2.1 time: 0.120866 Jul 14 11:23:03.642950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 368/704] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:03 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:04.220327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:04.220967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:04.228125 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.228584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.229430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.230002 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.367098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:04.368135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:04.376950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.377617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.378725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.379342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.385071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:04.393626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-98dcfd7f-ba45-4718-8da5-c2becf029284 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.177796 Jul 14 11:23:04.399201 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 337/705] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:04 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:04.463217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:04.463838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:04.472660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.473176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.473969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.474460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.540675 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:04.549949 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:04.551535 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:04.552746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e803189d-495b-4571-be3a-716e6345f20f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.192404 Jul 14 11:23:04.553324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 369/706] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:04 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:23:04.628382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:04.636418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6d895180-49a5-462d-b1fb-a510edcc72fa tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.177210 Jul 14 11:23:04.637001 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 338/707] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:04 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:04.665805 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:04.666417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:04.675587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.676172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.677058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:04.677629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:04.948936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:04.963728 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-661cba68-0106-40e7-bdb1-e05bfdac3bf2 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.301040 Jul 14 11:23:04.965224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 370/708] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:04 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:05.418151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:05.419615 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:05.427101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.427619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.428436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.428947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.573791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:05.574981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:05.586348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.587246 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.588390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.588971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.616351 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:05.632812 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3bd434c3-2d7c-4d09-91f2-876f9cd62900 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.218689 Jul 14 11:23:05.633879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 339/709] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:05 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:05.659591 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:05.660744 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:05.670454 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.671018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.671931 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.672445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.808604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:05.818139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:05.820224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:05.821857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f00538d0-8ef1-4722-9768-e4fcd98bb96c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.253191 Jul 14 11:23:05.822978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 371/710] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:05 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:23:05.865177 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:05.871529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-a89e1401-d835-4add-abcb-c1c59109121a req-25d77956-8beb-422d-a978-44e8c60ca774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf23a62d-7ce5-4d36-93d9-190297922633", "tag": "7544404b-e61d-45b9-88c7-1405982fdbff"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:05.878184 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4d9aeef0-00ef-47f9-868e-cc87ca64d57b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.224302 Jul 14 11:23:05.878919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 340/711] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:05 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:05.887963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-a89e1401-d835-4add-abcb-c1c59109121a req-25d77956-8beb-422d-a978-44e8c60ca774 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.889439 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-a89e1401-d835-4add-abcb-c1c59109121a req-25d77956-8beb-422d-a978-44e8c60ca774 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.907887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-a89e1401-d835-4add-abcb-c1c59109121a req-25d77956-8beb-422d-a978-44e8c60ca774 service nova] Creating event network-changed:7544404b-e61d-45b9-88c7-1405982fdbff for instance cf23a62d-7ce5-4d36-93d9-190297922633 on hv-cinder-82282 Jul 14 11:23:05.913308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-a89e1401-d835-4add-abcb-c1c59109121a req-25d77956-8beb-422d-a978-44e8c60ca774 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057256 Jul 14 11:23:05.913994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 372/712] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:05.984412 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:05.985037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:05.992156 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.992617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:05.993435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:05.993879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:06.162737 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:06.174458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d70761ba-4dbc-4206-876a-38cda996eeb6 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.194766 Jul 14 11:23:06.175364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 341/713] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:05 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:06.654627 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:06.656569 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:06.667253 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:06.667729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:06.668498 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:06.668943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:06.684469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:06.849304 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:06.851485 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:06.859493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:06.860896 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:06.862124 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:06.862337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:06.863146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:06.877519 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-11eb31b0-7fa4-44ec-9e0b-b78700c52439 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.229225 Jul 14 11:23:06.878124 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 373/714] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:06 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:06.897742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:06.898352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:06.906116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:06.906816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:06.907823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:06.908456 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:07.038081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:07.050427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:07.052063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:07.053459 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7d626292-a667-45df-9544-a91cd9c3d430 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.213737 Jul 14 11:23:07.054015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 342/715] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:06 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:07.099030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:07.108847 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-89dc99ae-be37-4dc0-82b9-1ded55cb262e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.214486 Jul 14 11:23:07.109479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 374/716] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:06 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:07.201526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:07.420850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:07.420850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:07.420850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:07.420850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:07.421912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:07.421912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:07.421912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-324325a9-fca6-47b8-a5bf-6f73ec2477be tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.184085 Jul 14 11:23:07.421912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 343/717] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:07 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:07.901959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:07.902680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:07.910677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:07.911170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:07.912001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:07.912437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.072798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:08.080499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cb6a9f82-6f71-4575-86f3-09ca8bb828cc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.182425 Jul 14 11:23:08.081090 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 375/718] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:07 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:08.081539 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:08.082162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:08.089252 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:08.089858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.090732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:08.091222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.108341 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:08.127366 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:08.129761 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:08.134782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:08.135436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.136068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:08.136641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.268676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:08.280105 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:08.282216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:08.283486 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-36b535ce-ddb2-4450-b668-f26c7266a538 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.205992 Jul 14 11:23:08.284436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 344/719] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:08 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:08.308824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:08.317541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-82f4f678-fe68-4d9e-9a1c-62eb6780d4e0 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.195015 Jul 14 11:23:08.318362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 376/720] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:08 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:08.400256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:08.400935 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:08.409474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:08.410193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.411485 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:08.412172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:08.599228 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:08.599491 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-90cf866f-607a-4435-93ce-7ed90f029366 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.202938 Jul 14 11:23:08.600056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 345/721] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:08 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:09.098874 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:09.099671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:09.108311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.108771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.109604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.110043 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.301720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:09.305429 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:09.306057 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:09.312342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-22fa9cb7-b0e9-4cc2-ade1-eca3cc050af4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.217349 Jul 14 11:23:09.314774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.315495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.316668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.317479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.325442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 377/722] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:09 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:09.345392 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:09.346249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:09.352749 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.353408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.354420 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.354860 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.496087 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:09.509171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:09.511671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:09.512894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b9701045-b98f-48b4-9998-0adc5447480b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.212546 Jul 14 11:23:09.514651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 346/723] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:09 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:09.596349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:09.604565 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c90f680c-e88b-4df0-8ba8-cb81074f4796 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.264175 Jul 14 11:23:09.605152 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 378/724] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:09 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:09.623313 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:09.624489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:09.635998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.636816 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.638227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:09.639701 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:09.809831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:09.818849 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-327c5fe2-f3b9-43e4-845b-8ea577378693 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.204128 Jul 14 11:23:09.819470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 347/725] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:09 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:10.022082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:10.043704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-00716625-897c-4aef-87fb-78ed3c86dd3a req-b5f45873-bf97-4edf-bed4-ac6b218e8ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "name": "network-vif-plugged", "status": "completed", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:10.048424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=6 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:10.053260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-00716625-897c-4aef-87fb-78ed3c86dd3a req-b5f45873-bf97-4edf-bed4-ac6b218e8ed4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.053705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-00716625-897c-4aef-87fb-78ed3c86dd3a req-b5f45873-bf97-4edf-bed4-ac6b218e8ed4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.065824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-00716625-897c-4aef-87fb-78ed3c86dd3a req-b5f45873-bf97-4edf-bed4-ac6b218e8ed4 service nova] Creating event network-vif-plugged:0cba2204-9945-44b4-b7d6-bf19dc81c7cc for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c on hv-cinder-82282 Jul 14 11:23:10.070715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-00716625-897c-4aef-87fb-78ed3c86dd3a req-b5f45873-bf97-4edf-bed4-ac6b218e8ed4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092607 Jul 14 11:23:10.073546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 379/726] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:10.332922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:10.333541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:10.335482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:10.340811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.341265 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.342854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.343403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.474925 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:10.484337 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d741ab79-e586-4aba-aec8-86f27d46f8b8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.155318 Jul 14 11:23:10.485336 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 348/727] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:10 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:10.534931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:10.535666 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:10.543368 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.543816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.544621 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.545863 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.621814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:10.628170 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:10.628547 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.628977 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.629766 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.630203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.681861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:10.690785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:10.692306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:10.693466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7a4a03ee-200f-4ca5-bcdd-3609d9c43bb5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.162831 Jul 14 11:23:10.694336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 380/728] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:10 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:10.774750 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:10.783063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7a7d1d14-e2c0-4df6-9c61-67b3e6a28496 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.165123 Jul 14 11:23:10.783666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 349/729] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:10 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:10.836286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:10.836937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:10.844224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.844670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.845449 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:10.845887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:10.985545 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:10.993240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-67dc6638-5fbe-4464-b137-87bc4187e4fd tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.160949 Jul 14 11:23:10.993834 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 381/730] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:10 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:11.502288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:11.502911 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:11.509926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.510381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.511203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.511676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.657318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:11.665710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9c07c9a9-3052-46f2-8ce1-72b44d577f4c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.168100 Jul 14 11:23:11.666293 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 350/731] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:11 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:11.712529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:11.713156 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:11.720501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.720958 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.721739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.722181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.801392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:11.802741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:11.811548 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.812203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.813368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:11.814093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:11.893798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:11.905674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:11.910997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:11.912656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8f386cf5-2ec9-40f7-9cba-3f40328436d4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.203962 Jul 14 11:23:11.912853 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 382/732] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:11 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:11.981344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:11.993554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ce5abe54-dd39-4127-b7e2-701855504c22 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.196271 Jul 14 11:23:11.994179 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 351/733] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:11 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:12.011932 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:12.012668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:12.019318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.019766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.020561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.021006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.188311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:12.197593 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bd586e7b-371e-4720-b91b-ed67bcc7b8b8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.189589 Jul 14 11:23:12.198229 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 383/734] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:12 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:12.688488 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:12.689396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:12.698718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.699498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.700462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.701986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.873214 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:12.885909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a81c780c-41a9-4c0b-8930-4927b885ef7a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.204524 Jul 14 11:23:12.886885 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 352/735] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:12 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:12.932400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:12.932991 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:12.940639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.941082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:12.941872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:12.942339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.011311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:13.012008 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:13.020000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:13.020445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.021233 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:13.021671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.113894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:13.124980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:13.127114 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:13.128783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8d302aa8-7135-42a9-ab80-eec496e9cc1e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.200070 Jul 14 11:23:13.129643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 384/736] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:12 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:23:13.198268 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:13.209200 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ac68137f-035e-4085-9133-e240dfe38b96 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.201821 Jul 14 11:23:13.210185 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 353/737] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:13 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:13.216935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:13.218351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:13.225181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:13.225580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.226669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:13.226860 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.384562 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:13.396822 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2ee73add-9469-4a88-bf6e-c1168d89140c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.184132 Jul 14 11:23:13.397425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 385/738] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:13 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:13.915838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:13.920099 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:13.924079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:13.924527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:13.925413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:13.925741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.104773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.114224 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0a0b3b0d-0dff-4144-b3fd-cd89ebc81c10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1722 microversion: 2.1 time: 0.202168 Jul 14 11:23:14.114881 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 354/739] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:13 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:14.156963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:14.157839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:14.168020 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.168563 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.169672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.170360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.229514 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:14.230581 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:14.241848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.242857 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.245964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.246519 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.343415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.354333 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.368897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.368897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1e390fb8-383f-4130-9ecf-173b0915038f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.206209 Jul 14 11:23:14.370235 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 386/740] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:14 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:14.414362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:14.415372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:14.423517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.423517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.424191 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.424706 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.447586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.460772 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ed93a75f-86e0-46a8-96d8-74f089f14582 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.235261 Jul 14 11:23:14.462388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 355/741] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:14 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:14.575433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:14.581436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5f0ef3db-9cfa-4b6b-8758-8dd32b73e637 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.171269 Jul 14 11:23:14.587175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 387/742] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:14 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:14.712309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-11a95234-a916-4d25-992c-549df5cd88ad req-11711e9a-edab-476d-9d57-e290b1b73f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "name": "network-vif-plugged", "status": "completed", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:14.721036 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-11a95234-a916-4d25-992c-549df5cd88ad req-11711e9a-edab-476d-9d57-e290b1b73f8d service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:14.721492 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-11a95234-a916-4d25-992c-549df5cd88ad req-11711e9a-edab-476d-9d57-e290b1b73f8d service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:14.733499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-11a95234-a916-4d25-992c-549df5cd88ad req-11711e9a-edab-476d-9d57-e290b1b73f8d service nova] Creating event network-vif-plugged:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:23:14.738951 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-11a95234-a916-4d25-992c-549df5cd88ad req-11711e9a-edab-476d-9d57-e290b1b73f8d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030389 Jul 14 11:23:14.739677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 356/743] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:15.132206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:15.132830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:15.140257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.140748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.141579 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.142022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.340697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.350390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5f4127eb-0f90-49a8-9b8e-2b08cc0361d6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1699 microversion: 2.1 time: 0.222139 Jul 14 11:23:15.350988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 388/744] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:15 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1699 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:15.369390 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7885f6a0-797c-483f-bb5d-4dca8aa1f0cb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:15.372151 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=82 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:15.378359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7885f6a0-797c-483f-bb5d-4dca8aa1f0cb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.378690 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:15.378917 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7885f6a0-797c-483f-bb5d-4dca8aa1f0cb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.379440 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:15.389534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.390058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.390937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.391475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.456780 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7885f6a0-797c-483f-bb5d-4dca8aa1f0cb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Going to try to start instance {{(pid=118244) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:23:15.578566 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.588117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.589646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.590965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1bd75cd2-e4b6-43a9-b088-a58f57dcfb65 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.218238 Jul 14 11:23:15.594103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 389/745] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:15 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:15.602592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:15.603664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:15.610837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.611335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.612256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.612702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.656891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7885f6a0-797c-483f-bb5d-4dca8aa1f0cb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action" status: 202 len: 0 microversion: 2.1 time: 0.291675 Jul 14 11:23:15.657507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 357/746] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:23:15 2022] POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:23:15.664188 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:15.665279 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:15.672435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.672988 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.673907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.674386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.777844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.781375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:15.788911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a3f44141-43b1-4827-90f2-7ce3e296f4f1 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1258 microversion: 2.1 time: 0.193354 Jul 14 11:23:15.794094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 390/747] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:15 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:15.794236 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:15.794851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:15.801876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.802317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.803100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:15.803580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:15.863154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.871934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4ed16a3b-4d25-47e0-a324-bb298a425ea8 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.212663 Jul 14 11:23:15.872771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 358/748] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:15 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:15.984530 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:15.993553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7ea6fe69-8407-4d59-87dd-43295554733b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1708 microversion: 2.1 time: 0.202973 Jul 14 11:23:15.994145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 391/749] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:15 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1708 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:16.611331 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:16.612025 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:16.620305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.620762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.621603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.622081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.767746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:16.776237 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:16.777729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:16.778894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8774f825-a23f-458a-a81e-875fbf3ca2e2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.172148 Jul 14 11:23:16.779504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 359/750] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:16 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:16.813053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:16.813689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:16.820376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.820839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.821611 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.822051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.900422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:16.900422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:16.906249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.907248 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.908148 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:16.908795 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:16.985426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:16.997729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bc2276eb-cb85-4ced-967f-296bcb31c883 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1441 microversion: 2.1 time: 0.188914 Jul 14 11:23:17.000051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 392/751] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:16 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1441 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:17.020299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:17.020299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:17.029065 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.030153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.031500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.031949 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.081617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:17.084033 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:17.095562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-354eb6ad-f240-43aa-acb3-f114a5020bc3 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.207364 Jul 14 11:23:17.099103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 360/752] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:16 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:17.104571 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:17.105436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:17.121913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.122412 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.124109 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.124109 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.299500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:17.315031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6aca4182-607b-4f54-9780-9b2bc03d6f5d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1708 microversion: 2.1 time: 0.302577 Jul 14 11:23:17.316374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 393/753] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:17 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1708 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:17.412705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-616d9933-22e4-4b08-83cd-54a796f76ae6 req-27f78d87-3540-4e31-9c65-43c89989e63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf23a62d-7ce5-4d36-93d9-190297922633", "name": "network-vif-plugged", "status": "completed", "tag": "7544404b-e61d-45b9-88c7-1405982fdbff"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:17.421522 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-616d9933-22e4-4b08-83cd-54a796f76ae6 req-27f78d87-3540-4e31-9c65-43c89989e63a service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.421974 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-616d9933-22e4-4b08-83cd-54a796f76ae6 req-27f78d87-3540-4e31-9c65-43c89989e63a service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.433438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-616d9933-22e4-4b08-83cd-54a796f76ae6 req-27f78d87-3540-4e31-9c65-43c89989e63a service nova] Creating event network-vif-plugged:7544404b-e61d-45b9-88c7-1405982fdbff for instance cf23a62d-7ce5-4d36-93d9-190297922633 on hv-cinder-82282 Jul 14 11:23:17.438793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-616d9933-22e4-4b08-83cd-54a796f76ae6 req-27f78d87-3540-4e31-9c65-43c89989e63a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 Jul 14 11:23:17.446033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 394/754] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:23:17.456436 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:17.477810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-66876247-74cf-4207-ab2d-b03a074fed0b tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1441 microversion: 2.1 time: 0.363389 Jul 14 11:23:17.477810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 361/755] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:17 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1441 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:17.799524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:17.800235 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:17.809959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.810402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:17.812672 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:17.813539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.080379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:18.101946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:18.105334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:18.107952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8fea6fa3-1b39-4f61-9c47-d21414e587d7 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.313086 Jul 14 11:23:18.109710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 395/756] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:17 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:18.119575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:18.124489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:18.136540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:18.137446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.139460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:18.140789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.334472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:18.335352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:18.342718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:18.343310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.344132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:18.344580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:18.351083 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:18.360903 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b1c2e9c6-5800-4173-a5a5-3c3f752d2c17 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.249238 Jul 14 11:23:18.361630 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 362/757] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:18 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:18.491937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:18.500873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-09c34751-6702-4fc1-9163-2635416a62ec tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1708 microversion: 2.1 time: 0.171084 Jul 14 11:23:18.504072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 396/758] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:18 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1708 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:19.131578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:19.133440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:19.142109 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:19.142827 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:19.144152 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:19.144893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:19.379421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:19.388404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:19.388404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:19.388404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:19.388404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:19.388762 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:19.412582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:19.422619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:19.425764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:19.425764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-43c26385-f831-4b05-8e4d-5fcba2bed883 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.301651 Jul 14 11:23:19.437234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 363/759] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:19 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:23:19.522037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:19.523838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:19.531163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:19.531584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:19.532478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:19.532995 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:19.534561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:19.542942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f52f795f-cbde-4ecb-8e3c-1391d87fb481 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.167917 Jul 14 11:23:19.552081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 397/760] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:19 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:19.757156 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:19.766858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-94072c25-1225-4aeb-bf05-adecaab743d5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1708 microversion: 2.1 time: 0.249461 Jul 14 11:23:19.778724 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 364/761] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:19 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1708 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:20.447157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:20.449249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:20.467987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.469041 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.470357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.471059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.575090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:20.575090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:20.581913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.582378 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.584456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.585396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.669841 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:20.684546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:20.693011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:20.693011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d25f7d8d-e670-4e69-804f-831d4f808022 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.247495 Jul 14 11:23:20.693011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 398/762] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:20 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:20.789286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-e77b1f86-2914-4733-8390-903e2eb17072 req-048f9895-fc0b-43e5-a524-d36288d4518f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:20.800492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e77b1f86-2914-4733-8390-903e2eb17072 req-048f9895-fc0b-43e5-a524-d36288d4518f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.806922 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e77b1f86-2914-4733-8390-903e2eb17072 req-048f9895-fc0b-43e5-a524-d36288d4518f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.814065 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-e77b1f86-2914-4733-8390-903e2eb17072 req-048f9895-fc0b-43e5-a524-d36288d4518f service nova] Creating event network-changed:0cba2204-9945-44b4-b7d6-bf19dc81c7cc for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c on hv-cinder-82282 Jul 14 11:23:20.820088 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-e77b1f86-2914-4733-8390-903e2eb17072 req-048f9895-fc0b-43e5-a524-d36288d4518f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127472 Jul 14 11:23:20.821024 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 399/763] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:20.826419 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:20.827835 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:20.836659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.841287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.841287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:20.841287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:20.843345 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:20.851078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3eb12217-bbb5-45ce-b532-14fca96e05c9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.292423 Jul 14 11:23:20.852315 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 365/764] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:20 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:20.995865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:21.004727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7c843efa-ecf9-4c68-8aa6-2970a2234b0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1708 microversion: 2.1 time: 0.182741 Jul 14 11:23:21.005337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 400/765] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:20 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1708 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:21.727997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:21.734678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:21.738553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:21.739381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:21.740165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:21.740597 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:21.870708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:21.871711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:21.885376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:21.885829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:21.886622 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:21.887068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:21.953011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:21.953886 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:21.956450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:21.958641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dae3d882-1963-44b1-8c0d-fbc863f94692 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1809 microversion: 2.20 time: 0.242050 Jul 14 11:23:21.973874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 366/766] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:21 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:22.028299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:22.029340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:22.038786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:22.039300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:22.040634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:22.041670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:22.083546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:22.109775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0b016afc-bf22-4e2a-96c3-75078072e1f9 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1318 microversion: 2.1 time: 0.242699 Jul 14 11:23:22.110718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 401/767] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:21 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:22.230870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:22.241019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-50b5e4c6-5765-4567-a7f3-8e7ab77b1088 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1708 microversion: 2.1 time: 0.219517 Jul 14 11:23:22.241642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 367/768] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:22 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1708 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:22.981122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:22.981982 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:22.990131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:22.990640 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:22.991546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:22.992027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.136290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:23.137546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:23.149891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:23.150690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.152378 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:23.153155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.182330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:23.192651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:23.194135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:23.195345 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-007fb65a-a98f-44a6-bb3d-16fb602586ae tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1796 microversion: 2.20 time: 0.218996 Jul 14 11:23:23.195890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 402/769] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:23:22 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1796 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:23:23.269478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:23.270529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:23.277922 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:23.278916 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.281348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:23.281536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.344246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:23.350969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c0ffe2e8-37a9-4349-8b70-ed9178d82250 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1506 microversion: 2.1 time: 0.222060 Jul 14 11:23:23.351519 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 368/770] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:23 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:23.379406 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e85c99df-a497-4e18-9c66-21a0dbe4f90f", "device": "/dev/sdb"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:23.380870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:23.389667 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:23.390207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.391556 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:23.392015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:23.501077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:23.514061 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-89d4d3b3-34e7-470b-8fab-75daf92554f6 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1712 microversion: 2.1 time: 0.251742 Jul 14 11:23:23.514900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 403/771] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:23 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1712 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:25.744684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bf108ac2-0f1e-4eb0-af5e-afbdfedb6d2f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "POST /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.371294 Jul 14 11:23:25.745624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 369/772] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:23:23 2022] POST /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633/os-volume_attachments => generated 194 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:23:32.723233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:32.725086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:32.728948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:32.737319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:32.741403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:32.741403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:32.741403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:32.981249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-17485517-808b-4746-a788-a9a9c9683b61 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/action" status: 202 len: 0 microversion: 2.1 time: 0.265105 Jul 14 11:23:32.981896 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 404/773] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:23:32 2022] POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:23:32.996552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:32.997965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:33.009220 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:33.009989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:33.011524 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:33.012142 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:33.221553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:33.230524 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5259650f-3827-4b59-b73c-7449081d9d0b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1752 microversion: 2.1 time: 0.243370 Jul 14 11:23:33.232244 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 370/774] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:32 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1752 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:34.254575 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:34.255507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:34.266813 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:34.267500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:34.268680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:34.269302 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:34.681552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:34.696351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b449ff61-bf17-4238-81de-c31d4bdccdd7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1752 microversion: 2.1 time: 0.448633 Jul 14 11:23:34.697582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 405/775] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:34 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1752 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:35.722416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:35.723437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:35.729942 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:35.730383 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:35.731177 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:35.731621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:35.914284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:35.930534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d874ff0c-1a27-4f1c-a3ce-8e90f9a9d425 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.209992 Jul 14 11:23:35.930534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 371/776] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:35 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:36.951876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:36.954448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:36.964072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:36.964826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:36.966122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:36.966860 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:37.144132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:37.152761 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-acbbfce1-c726-4c97-8d92-4f37456dca0d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.207992 Jul 14 11:23:37.153342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 406/777] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:36 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:38.180990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:38.182227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:38.200875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:38.201356 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:38.202120 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:38.203394 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:38.386580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:38.399846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d355006f-e8fa-4c28-83e5-d62604191a52 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.223876 Jul 14 11:23:38.400464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 372/778] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:38 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:39.421118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:39.421843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:39.429110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:39.434175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:39.434175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:39.434175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:39.589241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:39.591561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:39.598100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c2f1d673-2f6d-4753-80a7-df0d23fd58dd tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.183461 Jul 14 11:23:39.598787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 407/779] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:39 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:40.616647 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:40.617435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:40.629043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:40.630381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:40.631783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:40.632561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:40.813859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:40.822493 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f28bc0a1-7fbb-4821-8655-13c317412a9d tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.210823 Jul 14 11:23:40.823079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 373/780] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:40 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:41.841118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:41.841858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:41.849939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:41.850382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:41.851201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:41.851643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:42.043288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:42.051925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1d33cfd4-a679-4908-b2d5-315b393a13f2 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.214635 Jul 14 11:23:42.052532 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 408/781] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:41 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:43.070577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:43.071326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:43.078642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:43.079102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:43.080077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:43.080634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:43.277010 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:43.287967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ed239830-3fe4-498b-9e31-f32856f4b4eb tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.221759 Jul 14 11:23:43.288544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 374/782] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:43 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:44.308880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:44.309898 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:44.321503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:44.322234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:44.323560 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:44.324258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:44.548382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:44.557612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-14eeb604-e069-49fc-9101-1988aa241da8 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.255088 Jul 14 11:23:44.558260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 409/783] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:44 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:45.576517 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:45.577140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:45.580668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=36 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:45.585844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:45.586285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:45.587071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:45.587609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:45.758716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:45.772439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8ef8bc4e-4e9d-4588-b87e-73b0b7e90a23 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.199730 Jul 14 11:23:45.773024 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 375/784] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:45 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:46.795496 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:46.797189 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:46.804911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:46.805367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:46.806153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:46.806594 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:46.988843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:46.997825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5cf75b35-b208-4840-8df0-8c73057ba1c7 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.207832 Jul 14 11:23:46.998404 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 410/785] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:46 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:48.020689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:48.021328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:48.029162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:48.029730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:48.030504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:48.030938 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:48.034191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:48.190016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:48.202255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9a874234-0bdd-4293-b4ae-fe611598d385 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.189727 Jul 14 11:23:48.202838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 376/786] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:48 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:49.220775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:49.221599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:49.228169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:49.228618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:49.229390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:49.229823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:49.401867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:49.411186 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-57e02ff6-357b-4d95-99f6-51ba04104874 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.194979 Jul 14 11:23:49.411780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 411/787] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:49 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:50.430577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:50.431620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:50.439586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:50.440086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:50.441107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:50.441632 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:50.640067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:50.655225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-32e28a59-e813-437b-901c-8fd2f6b86ef3 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.228244 Jul 14 11:23:50.656326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 377/788] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:50 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:51.677297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:51.677853 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:51.685785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:51.686237 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:51.687024 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:51.688324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:51.879475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:51.888630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-066539bb-0013-4b5b-936d-330ba0b31313 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.215735 Jul 14 11:23:51.889209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 412/789] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:51 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:52.556197 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:52.556767 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:52.568161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:52.568606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:52.569383 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:52.569820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:52.867106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lazy-loading 'services' on Instance uuid cf23a62d-7ce5-4d36-93d9-190297922633 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:23:52.906952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:52.915212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:52.916994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:52.917720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:52.918973 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:52.919611 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:53.110073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:53.114744 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d3338cfc-7d35-490c-8282-703cc6d79090 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.212184 Jul 14 11:23:53.115453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 413/790] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:52 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:53.238937 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-50f2ce97-bf91-4bcf-b228-28409f77fe93 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633/os-volume_attachments/e85c99df-a497-4e18-9c66-21a0dbe4f90f" status: 202 len: 0 microversion: 2.1 time: 0.686278 Jul 14 11:23:53.239791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 378/791] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:23:52 2022] DELETE /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633/os-volume_attachments/e85c99df-a497-4e18-9c66-21a0dbe4f90f => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:23:54.137689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:54.138787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:54.147144 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:54.147764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:54.149033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:54.149581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:54.318300 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:54.327856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bf444829-06c6-4f2e-a415-f3583d874d8a tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.197827 Jul 14 11:23:54.328953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 414/792] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:54 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:55.012902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a7c7c1a-0ea6-4be7-af4f-7005b2482080"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:23:55.014124 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:55.021835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:55.022288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:55.023394 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:55.023838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:55.351720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:55.352864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:55.367793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:55.368467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:55.369977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:55.370117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:55.572022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:55.583775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6d83e949-edd9-444e-9a90-d90b35e3babc tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.238219 Jul 14 11:23:55.587869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 415/793] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:55 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:55.593081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:55.593879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:55.601403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:55.601845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:55.602617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:55.603049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:55.632118 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:23:56.096014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-623b9037-6799-4ff5-b98d-76ff7ddd930f tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 204 len: 0 microversion: 2.1 time: 0.509239 Jul 14 11:23:56.096628 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 416/794] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:23:55 2022] DELETE /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:23:56.101394 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c1118806-2da3-4d69-91ea-865eff6edf97 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.242493 Jul 14 11:23:56.103190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 379/795] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:23:54 2022] POST /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments => generated 194 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:23:56.108854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:56.110055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:56.117611 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:56.118078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:56.119376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:56.120076 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:56.323105 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:56.333188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-379700f2-b1d7-427b-9481-6e1c36eb810c tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1512 microversion: 2.1 time: 0.230849 Jul 14 11:23:56.333754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 417/796] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:56 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:56.605098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:56.605794 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:56.612870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:56.613350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:56.614130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:56.614562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:56.815247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:56.824648 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a7df7946-264e-47f6-a546-51ae348f5647 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.224232 Jul 14 11:23:56.825239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 380/797] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:56 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:57.350902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:57.351554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:57.358662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:57.359103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:57.360544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:57.360979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:57.522774 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:57.535968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-13f43076-d2cd-4364-a6a4-3577829f163e tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1512 microversion: 2.1 time: 0.188717 Jul 14 11:23:57.536783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 418/798] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:57 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:57.846348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:57.847515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:57.858122 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:57.858748 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:57.861183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:57.861661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:58.033983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:58.049204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b452ed9c-c29c-4be6-a5d0-d07cf29a33ef tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1757 microversion: 2.1 time: 0.209274 Jul 14 11:23:58.049995 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 381/799] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:57 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:58.555353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:58.556218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:58.563390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:58.563980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:58.564849 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:58.565287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:58.763030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:58.778984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-95f83d67-934e-493f-9fe6-bad1e92c6933 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1512 microversion: 2.1 time: 0.227343 Jul 14 11:23:58.780008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 419/800] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:58 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:23:59.068768 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:59.069786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:59.078879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:59.079554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:59.080470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:59.081048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:59.329537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:23:59.340713 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5d25d39d-9819-4509-a7be-e8c1c2fb9c62 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1760 microversion: 2.1 time: 0.276384 Jul 14 11:23:59.341596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 382/801] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:59 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1760 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:23:59.811138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:23:59.812206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:23:59.824548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:59.825332 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:23:59.826682 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:23:59.827462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:00.134869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:00.143432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dfcd54c8-7553-4b59-bfa8-9a2bc99b5e0d tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1512 microversion: 2.1 time: 0.339326 Jul 14 11:24:00.144029 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 420/802] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:23:59 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:00.751328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-7dfa04d1-a74c-42d7-a563-f7839c94de62 req-ca49fda4-cbef-4205-94b8-b112ccf8ce2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf23a62d-7ce5-4d36-93d9-190297922633", "name": "network-vif-deleted", "tag": "7544404b-e61d-45b9-88c7-1405982fdbff"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:00.762255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-7dfa04d1-a74c-42d7-a563-f7839c94de62 req-ca49fda4-cbef-4205-94b8-b112ccf8ce2a service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:00.763370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-7dfa04d1-a74c-42d7-a563-f7839c94de62 req-ca49fda4-cbef-4205-94b8-b112ccf8ce2a service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:00.776875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-7dfa04d1-a74c-42d7-a563-f7839c94de62 req-ca49fda4-cbef-4205-94b8-b112ccf8ce2a service nova] Creating event network-vif-deleted:7544404b-e61d-45b9-88c7-1405982fdbff for instance cf23a62d-7ce5-4d36-93d9-190297922633 on hv-cinder-82282 Jul 14 11:24:00.782621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-7dfa04d1-a74c-42d7-a563-f7839c94de62 req-ca49fda4-cbef-4205-94b8-b112ccf8ce2a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036825 Jul 14 11:24:00.783748 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 383/803] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:01.162458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:01.163161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:01.169872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:01.170359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:01.171226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:01.171691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:01.222617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:01.223374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:01.224107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lazy-loading 'fault' on Instance uuid cf23a62d-7ce5-4d36-93d9-190297922633 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:24:01.285513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2e478cdbb04617b48f388a4b38bd35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11215c9c5f59498c8110024722b1529c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:01.289887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b5efd9d8-ff77-424c-8d51-2c97544beebc tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 200 len: 1308 microversion: 2.1 time: 0.131401 Jul 14 11:24:01.290480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 421/804] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:01 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:02.310373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:02.311194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] [instance: cf23a62d-7ce5-4d36-93d9-190297922633] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:02.319231 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:02.319691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:02.320481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:02.320934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:02.335968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] HTTP exception thrown: Instance cf23a62d-7ce5-4d36-93d9-190297922633 could not be found. Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Request method failure captured: Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 HTTP/1.1 Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_v21kcgjVLOac7VpjRAD4b2IPvhMK9K6_e1wc0NDHh6wGsHB49E8DMAX_THwgvIJ3KmzOXB3fE6szqgd87EH9jF5xkEtbGqg9XDTMP2kooM7moAAfVFyg_6CkgsNDK2eHhNoc8B8FbkD3qrqUYzTPJwW5A7jPkTDCWh3wL3-QMexAc Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 11215c9c5f59498c8110024722b1529c Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-VolumesSnapshotTestJSON-326903276 Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:24:02.337745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_11215c9c5f59498c8110024722b1529c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/11215c9c5f59498c8110024722b1529c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11215c9c5f59498c8110024722b1529c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/11215c9c5f59498c8110024722b1529c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-VolumesSnapshotTestJSON-326903276 Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 11215c9c5f59498c8110024722b1529c Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-326903276 Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-VolumesSnapshotTestJSON-326903276-project Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: ee2e478cdbb04617b48f388a4b38bd35 Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-VolumesSnapshotTestJSON-326903276-project Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance cf23a62d-7ce5-4d36-93d9-190297922633 could not be found. Jul 14 11:24:02.339444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': 'cf23a62d-7ce5-4d36-93d9-190297922633'} Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf23a62d-7ce5-4d36-93d9-190297922633 could not be found. Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:24:02.340376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf23a62d-7ce5-4d36-93d9-190297922633 could not be found. Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf23a62d-7ce5-4d36-93d9-190297922633 could not be found. Jul 14 11:24:02.342174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:24:02.343900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] Returning 404 to user: Instance cf23a62d-7ce5-4d36-93d9-190297922633 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:24:02.343900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dfe3db20-ec1b-4063-bcba-2a8357fd6fb0 tempest-VolumesSnapshotTestJSON-326903276 tempest-VolumesSnapshotTestJSON-326903276-project] 10.222.0.59 "GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633" status: 404 len: 111 microversion: 2.1 time: 0.033386 Jul 14 11:24:02.343900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 384/805] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:02 2022] GET /compute/v2.1/servers/cf23a62d-7ce5-4d36-93d9-190297922633 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:24:12.266530 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:12.267988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:12.270777 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:12.271459 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:12.276425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:12.284829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:12.284829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:12.284829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:12.303669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'flavor' on Instance uuid a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:24:12.710754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-605745c7-8941-4ef5-8d65-ac1b6df77ab7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/action" status: 200 len: 32 microversion: 2.1 time: 0.447601 Jul 14 11:24:12.711924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 422/806] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:24:12 2022] POST /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/action => generated 32 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:24:12.724719 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:12.725585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:12.728486 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=19 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:12.729181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:12.735514 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:12.738401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:12.738401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:12.738909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:12.900954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:12.910023 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2e431575-d883-46ac-ac8b-2138c01e9779 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.190651 Jul 14 11:24:12.915894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 385/807] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:12 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:13.938965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:13.940109 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:13.947981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:13.948442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:13.949227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:13.949673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:14.105206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:14.113864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e53982b6-7c7c-4c8b-ae33-10bee5539a67 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.180384 Jul 14 11:24:14.114478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 423/808] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:13 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:15.132721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:15.133369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:15.140795 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:15.141280 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:15.142160 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:15.142600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:15.281472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:15.290167 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-761ed443-90c2-4e3d-97a9-0e734f5818fc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.161270 Jul 14 11:24:15.290735 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 386/809] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:15 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:16.308333 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:16.309029 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:16.317795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:16.318289 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:16.319159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:16.319598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:16.468326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:16.476785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f69fa0ab-cd59-4fd4-98a5-dc65a73fe957 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.172325 Jul 14 11:24:16.477356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 424/810] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:16 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:24:17.494872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:17.495596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:17.503210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:17.503704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:17.511260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:17.511260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:17.654800 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:17.664111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3fc7c5c8-fad1-4a17-a49b-667eef04edcc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.173499 Jul 14 11:24:17.664679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 387/811] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:17 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:18.682303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:18.683034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:18.692246 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:18.692890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:18.693878 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:18.694353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:18.856856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:18.865597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-32740019-c551-4ead-87fe-9d163de4247d tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.188337 Jul 14 11:24:18.866162 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 425/812] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:18 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:19.884241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:19.884880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:19.893150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:19.893726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:19.894591 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:19.895207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:20.039830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:20.048522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-35034c27-3caa-4bbe-bc4a-0fc747ea28d1 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.168130 Jul 14 11:24:20.054198 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 388/813] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:19 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:21.066144 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:21.066673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:21.073386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:21.073791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:21.074630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:21.075069 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:21.213183 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:21.222315 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7867f134-ff06-42aa-88c0-901d38c47084 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.160186 Jul 14 11:24:21.222891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 426/814] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:21 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:22.239493 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:22.240114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:22.247161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:22.247810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:22.248603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:22.249150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:22.387206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:22.395896 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c0e2a2d8-684a-45b3-8466-3d8124b62cfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.160830 Jul 14 11:24:22.396456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 389/815] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:22 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:23.419204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:23.419204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:23.421833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:23.422276 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:23.423074 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:23.423531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:23.574111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:23.582934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-97afe440-cd85-4538-bbdc-408f76f92676 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.172473 Jul 14 11:24:23.584215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 427/816] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:23 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:24.602650 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:24.603316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:24.609630 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:24.610073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:24.610889 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:24.611428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:24.756343 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:24.766395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a7204580-279d-4dad-a7d2-b3780f76ec9b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.169070 Jul 14 11:24:24.767031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 390/817] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:24 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:25.784406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:25.785174 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:25.792309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:25.792681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:25.793500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:25.794011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:25.943948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:25.954920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e85edb94-284f-4cd2-ae00-08ed13cabc1a tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.174467 Jul 14 11:24:25.958247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 428/818] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:25 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:24:26.973426 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:26.974328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:26.980983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:26.981440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:26.982253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:26.982925 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:27.148887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:27.157303 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0ad3cb4b-185e-4a75-bafd-a5bb6a659b12 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.188421 Jul 14 11:24:27.157887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 391/819] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:26 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:28.175674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:28.176206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:28.183019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:28.183503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:28.184290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:28.184730 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:28.337923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:28.347082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c50e4ea3-1d9b-4331-af39-d897563b3ff5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.175479 Jul 14 11:24:28.347697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 429/820] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:28 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:29.366410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:29.367023 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:29.377284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:29.378017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:29.379465 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:29.380232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:29.551592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:29.560373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-217a0f7c-5bc2-422c-882c-28102591846b tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.198604 Jul 14 11:24:29.561217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 392/821] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:29 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:30.578199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:30.584894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:30.585911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:30.586361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:30.587182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:30.587625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:30.743674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:30.754884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7ac730cc-588b-45ca-9a2b-e47eb62a9b9e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.179996 Jul 14 11:24:30.755514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 430/822] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:30 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:31.774589 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:31.775272 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:31.781830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:31.782271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:31.783052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:31.783513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:31.933980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:31.945479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-88d839db-fe92-422a-b66e-b19f3898c1b5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.176263 Jul 14 11:24:31.946058 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 393/823] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:31 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:32.962808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:32.963442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:32.970584 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:32.971037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:32.972067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:32.972515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:33.123644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:33.132478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4d0d3ab4-0e1b-4e1f-b7c9-72a6377803a3 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1737 microversion: 2.1 time: 0.173515 Jul 14 11:24:33.133054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 431/824] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:32 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:34.150264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:34.150877 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:34.157925 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:34.158418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:34.159238 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:34.159706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:34.310575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:34.319270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7f1645bf-7308-432a-b233-fbfd14569bfe tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1717 microversion: 2.1 time: 0.172865 Jul 14 11:24:34.319844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 394/825] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:34 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:34.384232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:34.384820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:34.393990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:34.394447 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:34.395691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:34.396079 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] HTTP exception thrown: Cannot 'detach_volume' instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 while it is in vm_state rescued Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Request method failure captured: Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments/2a7c7c1a-0ea6-4be7-af4f-7005b2482080 HTTP/1.1 Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s4s8eZc0yEZA9xVxWy755FnwSggKF-HEBU84sm1M6JV9jHFOV4lg2ORyRU_7Y9BQtsfqnMAudUP2ADsfzx18NKuuxncTH6tMPlf8sqB5Sk_7a3IhAYCkGzEuQGXNOZ7xuY-_VTtM8oWs_Lx7t_tW8qsGf5EBfBGZdPYLiBNHTScHY Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:24:34.513351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_08cc50e4caea44e2a2bb1413a35e3b6d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: e3e8aa5fc932453e95080fa836dfac0c Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:24:34.515059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Cannot 'detach_volume' instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 while it is in vm_state rescued Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'server_id': 'a64a13ae-3a63-4bdd-8113-cf2e9b4b3588', 'id': '2a7c7c1a-0ea6-4be7-af4f-7005b2482080'} Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:24:34.516009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 while it is in vm_state rescued Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 while it is in vm_state rescued Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:24:34.517641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Returning 409 to user: Cannot 'detach_volume' instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 while it is in vm_state rescued {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:24:34.518819 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2d8a3b1d-a3f8-4eb1-9708-5e26a3051a95 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments/2a7c7c1a-0ea6-4be7-af4f-7005b2482080" status: 409 len: 152 microversion: 2.1 time: 0.116938 Jul 14 11:24:34.518819 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 432/826] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:24:34 2022] DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments/2a7c7c1a-0ea6-4be7-af4f-7005b2482080 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 11:24:34.519003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:34.519003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:34.519003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:34.519003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:34.519398 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:34.519398 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:34.984187 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0ab394e5-0931-447a-b265-5fca0afd8ccc tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "POST /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/action" status: 202 len: 0 microversion: 2.1 time: 0.481818 Jul 14 11:24:34.984881 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 395/827] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:24:34 2022] POST /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:24:34.993065 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:34.993952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:34.999919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:35.000403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:35.001190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:35.001626 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:35.136881 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:35.146387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-48176f6e-7638-486b-bc8d-33da68ee67e7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1725 microversion: 2.1 time: 0.157037 Jul 14 11:24:35.166050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 433/828] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:34 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:36.170701 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:36.171343 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:36.178058 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:36.178509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:36.179321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:36.179756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:36.327078 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:36.343085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-aaf9462a-8837-4868-94fc-f6736b4079b8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1725 microversion: 2.1 time: 0.177107 Jul 14 11:24:36.343987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 396/829] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:36 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:37.362217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:37.362984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:37.370427 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:37.371017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:37.371728 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:37.372272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:37.514520 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:37.526529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8e8be442-9518-4a10-a7c9-cb01648f47e0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1725 microversion: 2.1 time: 0.168421 Jul 14 11:24:37.527136 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 434/830] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:37 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:38.544249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:38.544797 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:38.552048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:38.552537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:38.553322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:38.553754 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:38.702907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:38.712928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-76677996-9f6c-45ab-9eba-3d3317f2b317 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1725 microversion: 2.1 time: 0.172599 Jul 14 11:24:38.713656 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 397/831] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:38 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:39.730576 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:39.731212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:39.737858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:39.745393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:39.745393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:39.745393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:39.886711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:39.897494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9a721fdf-61f7-4ba1-a696-93d13b70e697 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1725 microversion: 2.1 time: 0.170836 Jul 14 11:24:39.898399 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 435/832] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:39 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:24:40.921063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:40.921791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:40.929396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:40.929850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:40.930627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:40.935437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:41.067696 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:24:41.075780 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b01bcfa9-fa2b-4ba2-8a59-2874694ca37e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1731 microversion: 2.1 time: 0.158547 Jul 14 11:24:41.076352 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 398/833] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:24:40 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:24:41.092542 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:24:41.093081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:24:41.101098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:41.101554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:41.102359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:41.102801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:41.120951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:41.184802 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8b58d210-f024-4b6a-98cb-ddc920c42b08 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096198 Jul 14 11:24:41.185488 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 436/834] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:24:41 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:24:42.172474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-6e9c3547-f4b0-4d19-aed8-08f62fe0bdb6 req-18bb1122-479e-4775-8ae0-880da2b7a26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64a13ae-3a63-4bdd-8113-cf2e9b4b3588", "tag": "46cab31c-2d94-46c2-a19b-9b2357606b0b"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:42.183702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-6e9c3547-f4b0-4d19-aed8-08f62fe0bdb6 req-18bb1122-479e-4775-8ae0-880da2b7a26a service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:42.184482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-6e9c3547-f4b0-4d19-aed8-08f62fe0bdb6 req-18bb1122-479e-4775-8ae0-880da2b7a26a service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:42.198205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-6e9c3547-f4b0-4d19-aed8-08f62fe0bdb6 req-18bb1122-479e-4775-8ae0-880da2b7a26a service nova] Creating event network-changed:46cab31c-2d94-46c2-a19b-9b2357606b0b for instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 on hv-cinder-82282 Jul 14 11:24:42.205167 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-6e9c3547-f4b0-4d19-aed8-08f62fe0bdb6 req-18bb1122-479e-4775-8ae0-880da2b7a26a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036983 Jul 14 11:24:42.205619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 399/835] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:24:44.222064 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-a17a528f-4c9d-4d45-8478-08a7c247820c req-b2a711a9-c3c8-40e0-9573-6b9c20d3df55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64a13ae-3a63-4bdd-8113-cf2e9b4b3588", "tag": "46cab31c-2d94-46c2-a19b-9b2357606b0b"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:24:44.226635 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=31 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:44.232180 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-a17a528f-4c9d-4d45-8478-08a7c247820c req-b2a711a9-c3c8-40e0-9573-6b9c20d3df55 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:24:44.232628 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-a17a528f-4c9d-4d45-8478-08a7c247820c req-b2a711a9-c3c8-40e0-9573-6b9c20d3df55 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:24:44.245320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-a17a528f-4c9d-4d45-8478-08a7c247820c req-b2a711a9-c3c8-40e0-9573-6b9c20d3df55 service nova] Creating event network-changed:46cab31c-2d94-46c2-a19b-9b2357606b0b for instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 on hv-cinder-82282 Jul 14 11:24:44.250557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-a17a528f-4c9d-4d45-8478-08a7c247820c req-b2a711a9-c3c8-40e0-9573-6b9c20d3df55 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033541 Jul 14 11:24:44.251188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 437/836] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:10.978975 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:10.979588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:10.981957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=30 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:10.982621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:10.987788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:10.988294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:10.989083 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:10.989527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.020402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6edc0df6-dbfa-4f0e-b4b5-15c2e280a6fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments/946f7f33-fa0e-4046-8500-9bdd5bd525d0" status: 200 len: 194 microversion: 2.20 time: 0.046025 Jul 14 11:25:11.021009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 400/837] 10.222.0.59 () {60 vars in 1453 bytes} [Thu Jul 14 11:25:10 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments/946f7f33-fa0e-4046-8500-9bdd5bd525d0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:25:11.087356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:11.087976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:11.095956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:11.096403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.097181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:11.097619 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.191478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lazy-loading 'services' on Instance uuid a91745f1-a0c6-47f3-8c7b-da031d0dc625 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:11.364999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:11.365496 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:11.372638 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:11.373085 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.373870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:11.374306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.430988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-21b6a323-94e1-44a4-9431-60950b632982 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments/946f7f33-fa0e-4046-8500-9bdd5bd525d0" status: 202 len: 0 microversion: 2.20 time: 0.348074 Jul 14 11:25:11.431718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 438/838] 10.222.0.59 () {60 vars in 1456 bytes} [Thu Jul 14 11:25:11 2022] DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments/946f7f33-fa0e-4046-8500-9bdd5bd525d0 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:25:11.443737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:11.443737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:11.450014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:11.450466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.451275 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:11.451711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:11.465700 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lazy-loading 'services' on Instance uuid 0e3c6670-5e21-4f8e-93c1-66a524a5510d {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:11.486061 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6bcac207-3ee9-4dd0-8acf-0ac75207a68c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048717 Jul 14 11:25:11.486853 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 439/839] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jul 14 11:25:11 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 11:25:11.752658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-32efd17f-f915-4a65-83d7-d751868be100 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-volume_attachments/f01e3db2-bc18-4b5a-ac94-ac65c09b7ffe" status: 202 len: 0 microversion: 2.1 time: 0.614338 Jul 14 11:25:11.753161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 401/840] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:25:11 2022] DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-volume_attachments/f01e3db2-bc18-4b5a-ac94-ac65c09b7ffe => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:25:12.499204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:12.500127 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:12.506756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:12.507262 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:12.508034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:12.508763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:12.692683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-18946167-947f-4c9a-ba1e-83b9f6b99542 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.197738 Jul 14 11:25:12.693294 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 440/841] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jul 14 11:25:12 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:25:13.707827 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:13.708884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:13.716356 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:13.716803 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:13.717572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:13.718013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:13.751861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fad6f228-e811-461b-a18f-f7bf337f4656 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048986 Jul 14 11:25:13.752573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 402/842] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jul 14 11:25:13 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:13.814711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:13.815287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:13.822233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:13.822680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:13.823492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:13.823934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:13.849551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:25:14.130719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e8ec04bf-14e8-4584-bf6e-64651310d5a2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 204 len: 0 microversion: 2.20 time: 0.319451 Jul 14 11:25:14.132168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 441/843] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jul 14 11:25:13 2022] DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 11:25:14.140338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:14.149743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:14.149743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:14.149743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:14.149743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:14.150189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:14.297051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:14.306641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:14.307926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:14.309095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-47767d95-a1d8-4ac1-8c81-aeec3e66d95e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.172777 Jul 14 11:25:14.309648 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 403/844] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:14 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:14.996461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1e1fc4a8-2561-4ad8-ab70-7fdc2789a308 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:15.003313 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1e1fc4a8-2561-4ad8-ab70-7fdc2789a308 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:15.003772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1e1fc4a8-2561-4ad8-ab70-7fdc2789a308 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:15.027183 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1e1fc4a8-2561-4ad8-ab70-7fdc2789a308 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Going to try to stop instance {{(pid=118245) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 11:25:15.262317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1e1fc4a8-2561-4ad8-ab70-7fdc2789a308 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action" status: 202 len: 0 microversion: 2.1 time: 0.270906 Jul 14 11:25:15.262960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 442/845] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:25:14 2022] POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:25:15.271450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:15.272056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:15.279610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:15.280056 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:15.280829 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:15.281262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:15.332502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:15.333369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:15.341895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:15.342360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:15.343198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:15.343631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:15.431899 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:15.439430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5304da16-9fd2-4d98-a1bd-b771aa809573 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.171831 Jul 14 11:25:15.441729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 404/846] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:15 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:15.512977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:15.521371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:15.522729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:15.524011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-14d7f035-e50f-409d-bc23-447511e45937 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.198578 Jul 14 11:25:15.525711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 443/847] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:15 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:25:16.459815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:16.460344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:16.467578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:16.468040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:16.468822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:16.469319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:16.545026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:16.545895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:16.552862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:16.553318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:16.554303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:16.554752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:16.625093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:16.635627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ac12ff4c-e8b4-4db6-918c-38aab2c75087 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.179817 Jul 14 11:25:16.636223 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 405/848] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:16 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:16.846900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:16.856194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:16.857833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:16.859030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dedea672-e369-45c7-a51d-9dcb54740338 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1724 microversion: 2.20 time: 0.317974 Jul 14 11:25:16.859620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 444/849] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:16 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:25:17.654488 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:17.656000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:17.665617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:17.666088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:17.666888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:17.667388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:17.838016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-6147a986-c86d-43ad-8f6d-e8e53b3d3f33 req-5602548d-d68a-4791-916f-0815fcaa08f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91745f1-a0c6-47f3-8c7b-da031d0dc625", "name": "network-vif-deleted", "tag": "0962defb-6c98-4126-9cda-aa5a2ba88351"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:17.847093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-6147a986-c86d-43ad-8f6d-e8e53b3d3f33 req-5602548d-d68a-4791-916f-0815fcaa08f9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:17.848153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-6147a986-c86d-43ad-8f6d-e8e53b3d3f33 req-5602548d-d68a-4791-916f-0815fcaa08f9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:17.862755 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:17.865441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-6147a986-c86d-43ad-8f6d-e8e53b3d3f33 req-5602548d-d68a-4791-916f-0815fcaa08f9 service nova] Creating event network-vif-deleted:0962defb-6c98-4126-9cda-aa5a2ba88351 for instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 on hv-cinder-82282 Jul 14 11:25:17.871868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-6147a986-c86d-43ad-8f6d-e8e53b3d3f33 req-5602548d-d68a-4791-916f-0815fcaa08f9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038579 Jul 14 11:25:17.873371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 445/850] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:17.884180 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-564bcb01-8afb-400b-9613-e228b20d3b92 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.227374 Jul 14 11:25:17.884180 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 406/851] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:17 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:17.888259 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:17.888977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:17.896601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:17.897090 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:17.897894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:17.898372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:18.004731 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:18.022907 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:18.027101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:18.029480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d13bd195-b206-4493-bf1b-65efe3913f2f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1657 microversion: 2.20 time: 0.146581 Jul 14 11:25:18.030592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 446/852] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:17 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1657 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:18.903264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:18.903932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:18.910897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:18.911381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:18.912177 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:18.912604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:19.052642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:19.053959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:19.062554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:19.063408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:19.064390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:19.065390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:19.120888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:19.121821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:19.122940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:19.124070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lazy-loading 'fault' on Instance uuid a91745f1-a0c6-47f3-8c7b-da031d0dc625 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:19.129464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d9e1126a-3908-465a-b995-6622a35f91fa tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.231578 Jul 14 11:25:19.130044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 407/853] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:18 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:19.192311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:19.203847 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:19.205329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:19.206390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1f081d56-f105-4ea9-959f-364398b5c264 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 200 len: 1371 microversion: 2.20 time: 0.158644 Jul 14 11:25:19.212214 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 447/854] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:19 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:25:20.152466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:20.153081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:20.159987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:20.160440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:20.161219 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:20.161658 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:20.226054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:20.226815 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:20.234330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:20.234787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:20.235613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:20.236051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] HTTP exception thrown: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Request method failure captured: Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 HTTP/1.1 Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s5XC7P8LTY0_sTqTTMMyjqOQ1FVTjPozv-Ja7wMg9697loLGRXsNXr2CU0-hEdX61raejfojElET7cbpHWdOraiTJZUJ_OLNVA4Zwk9p5m0QtQ7POI6WK1iFpUtSVM1FTbSwHbqkjh2k0buDVuCsPCce1rHyHMFQqOE3fSm53Qt9c Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:25:20.255851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f33c57605a974b44a62eebbdaba23ade", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3ac486b2d0ac42f9ba2fed7b17418b7a Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:25:20.257463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'a91745f1-a0c6-47f3-8c7b-da031d0dc625'} Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:25:20.258318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:25:20.260169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:20.261502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Returning 404 to user: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:25:20.261502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c5ed7261-71f0-4630-a3c1-4352b0617af5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 404 len: 111 microversion: 2.20 time: 0.032684 Jul 14 11:25:20.261502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 448/855] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:20 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 11:25:20.265587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7ec8f29a-7f4a-443c-9098-ecfc6740f6eb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '.version_select at 0x7f34122fe700>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:20.300169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:20.307833 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2384ecb6-b2da-40ef-9ad4-c1722d90cac9 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.159381 Jul 14 11:25:20.308408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 408/856] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:20 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:20.372155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7ec8f29a-7f4a-443c-9098-ecfc6740f6eb tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-599727113" status: 204 len: 0 microversion: 2.20 time: 0.110920 Jul 14 11:25:20.372742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 449/857] 10.222.0.59 () {60 vars in 1258 bytes} [Thu Jul 14 11:25:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-599727113 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 11:25:21.328603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:21.332596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:21.340155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:21.340602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:21.341386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:21.341821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:21.489080 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:21.501799 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1e011f6f-200f-4329-a41f-bf77437bdbe8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'create', calling method: .version_select at 0x7f3412254040>, body: {"keypair": {"name": "tempest-keypair-1398829927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGag6789zodoDAbtjMm/0Rkg1jW1nw3gAwoAZZOwQtxdUHiWnXRGzR/zwGIl5oHsETAYod38VNQQCy21/9yKL2wk0eP2vCxo5n9WxN7LcEX1eb0BT+QiljGCdo+NnKh//g=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:21.502405 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4073f928-ee2b-4169-a279-8b7282b1e13f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.180093 Jul 14 11:25:21.503508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 409/858] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:21 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:21.518826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-1e011f6f-200f-4329-a41f-bf77437bdbe8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for project f33c57605a974b44a62eebbdaba23ade. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:25:21.522919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-1e011f6f-200f-4329-a41f-bf77437bdbe8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for user 3ac486b2d0ac42f9ba2fed7b17418b7a and project f33c57605a974b44a62eebbdaba23ade. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:25:21.647535 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1e011f6f-200f-4329-a41f-bf77437bdbe8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.150255 Jul 14 11:25:21.648350 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 450/859] 10.222.0.59 () {62 vars in 1199 bytes} [Thu Jul 14 11:25:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 11:25:22.522064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:22.522718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:22.529987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:22.530450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:22.531299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:22.531731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:22.706866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:22.715764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0cb498d6-04f0-47b0-825a-84a50ac2474a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.197712 Jul 14 11:25:22.716623 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 410/860] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:22 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:23.242394 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-824085093"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:23.243742 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:23.251274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:23.251850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:23.252713 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:23.253226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:23.433502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.network.security_group_api [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Removing security group 5bea9673-7d18-46ef-917c-4a4edbe0d6e3 from port 263c0415-7821-4d36-9386-148556baecd3 Jul 14 11:25:23.734898 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:23.735617 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:23.743169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:23.743919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:23.744730 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:23.745438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:23.926411 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b65bced0-96e1-4db2-844d-e77feb782cd1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/action" status: 202 len: 0 microversion: 2.1 time: 0.809487 Jul 14 11:25:23.927372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 451/861] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:25:23 2022] POST /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:25:23.935473 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:23.937545 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-df15f814-d105-41ad-bdc8-520653b1f178 req-6d873901-aeec-4f25-8bc2-91e350520120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:23.945246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-35436e7d-87dc-444b-a018-58bbb3c8bd98 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.214219 Jul 14 11:25:23.957004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-df15f814-d105-41ad-bdc8-520653b1f178 req-6d873901-aeec-4f25-8bc2-91e350520120 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:23.957643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-df15f814-d105-41ad-bdc8-520653b1f178 req-6d873901-aeec-4f25-8bc2-91e350520120 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:23.957859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 411/862] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:23 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:23.973643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-df15f814-d105-41ad-bdc8-520653b1f178 req-6d873901-aeec-4f25-8bc2-91e350520120 service nova] Creating event network-changed:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:25:24.001955 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-df15f814-d105-41ad-bdc8-520653b1f178 req-6d873901-aeec-4f25-8bc2-91e350520120 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069820 Jul 14 11:25:24.006204 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 452/863] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:24.614909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1108911478", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "008ffa51-9a9b-4b5d-b7f8-a32846704948"}], "security_groups": [{"name": "tempest-securitygroup--815589504"}], "key_name": "tempest-keypair-1398829927", "user_data": "}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:24.730408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] validate_networks() for [('008ffa51-9a9b-4b5d-b7f8-a32846704948', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:25:24.970375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:24.971791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:24.979342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:24.980091 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:24.981925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:24.982372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.138140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:25:25.138746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:25:25.139172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:25:25.139785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:25:25.140338 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:25:25.149651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:25.150128 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.150939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:25.151419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.169984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for project f33c57605a974b44a62eebbdaba23ade. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:25:25.179033 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Getting quotas for user 3ac486b2d0ac42f9ba2fed7b17418b7a and project f33c57605a974b44a62eebbdaba23ade. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:25:25.192578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:25:25.194859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:25:25.201756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:25.210814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-858be87a-7de0-40de-b718-385e92e3725a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.246809 Jul 14 11:25:25.211515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 453/864] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:24 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:25.374372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [d728f558-cb34-42a6-b138-af26bbcf0559] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 11:25:25.559549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:25.560057 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:25.566310 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:25.566770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.567600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:25.568080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.645624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:25.649780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lazy-loading 'services' on Instance uuid 685d1643-5aaa-4ffe-9383-ac8338e0f070 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:25.863568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-562dcbe2-08d2-4db4-98f0-edd2a0ca28ca tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments/b6884ff7-481b-4afe-b7ad-2636ba084c15" status: 202 len: 0 microversion: 2.1 time: 0.308063 Jul 14 11:25:25.864374 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 454/865] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:25:25 2022] DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments/b6884ff7-481b-4afe-b7ad-2636ba084c15 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:25:25.875564 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:25.877155 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:25.884383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:25.884915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.885699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:25.886149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:25.916957 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-61047ae8-3a04-49a3-918d-88242fe49f56 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047315 Jul 14 11:25:25.917508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 455/866] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:25:25 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:26.019961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-a2afb845-6e0a-438b-be61-df30308e473a req-20dbadda-fbf3-4ec3-bffc-8d3dafcefda6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:26.029779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-a2afb845-6e0a-438b-be61-df30308e473a req-20dbadda-fbf3-4ec3-bffc-8d3dafcefda6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:26.030253 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-a2afb845-6e0a-438b-be61-df30308e473a req-20dbadda-fbf3-4ec3-bffc-8d3dafcefda6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:26.042739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-a2afb845-6e0a-438b-be61-df30308e473a req-20dbadda-fbf3-4ec3-bffc-8d3dafcefda6 service nova] Creating event network-changed:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:25:26.047704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-a2afb845-6e0a-438b-be61-df30308e473a req-20dbadda-fbf3-4ec3-bffc-8d3dafcefda6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031377 Jul 14 11:25:26.060518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 456/867] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:25:26.232568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:26.233379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:26.240571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:26.241075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:26.241819 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:26.242306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:26.382333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [d728f558-cb34-42a6-b138-af26bbcf0559] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 44944. Jul 14 11:25:26.387205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:26.388477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d45fc730-b892-4277-baa6-2ba6bcc72c31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.778231 Jul 14 11:25:26.394404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 412/868] 10.222.0.59 () {62 vars in 1187 bytes} [Thu Jul 14 11:25:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 11:25:26.395991 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e167de56-793c-42e9-9357-40db22b558c4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.169626 Jul 14 11:25:26.406145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 457/869] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:26 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:26.407293 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-34d60f50-4d9c-4563-9dbd-6cd6e866806a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:26.407293 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-34d60f50-4d9c-4563-9dbd-6cd6e866806a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:26.459004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-34d60f50-4d9c-4563-9dbd-6cd6e866806a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:26.468605 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-34d60f50-4d9c-4563-9dbd-6cd6e866806a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:26.470468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-34d60f50-4d9c-4563-9dbd-6cd6e866806a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:26.471714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-34d60f50-4d9c-4563-9dbd-6cd6e866806a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1282 microversion: 2.20 time: 0.076067 Jul 14 11:25:26.472277 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 413/870] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:26 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:25:26.929128 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:26.930058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:26.937334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:26.937784 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:26.938599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:26.939053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:26.971508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5010e50c-9dcd-4da5-8aba-6c1d2600e57b tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Jul 14 11:25:26.972085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 458/871] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:25:26 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:27.414395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:27.415012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:27.422314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:27.422832 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:27.423643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:27.424076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:27.491914 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-618c2711-bfbe-4d65-b110-5c6b9bb90c32 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:27.493382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-618c2711-bfbe-4d65-b110-5c6b9bb90c32 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:27.550587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-618c2711-bfbe-4d65-b110-5c6b9bb90c32 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:27.558316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-618c2711-bfbe-4d65-b110-5c6b9bb90c32 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:27.559911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-618c2711-bfbe-4d65-b110-5c6b9bb90c32 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:27.561044 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-618c2711-bfbe-4d65-b110-5c6b9bb90c32 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1282 microversion: 2.20 time: 0.075105 Jul 14 11:25:27.561599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 459/872] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:27 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:25:27.565325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:27.574126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-791f7ad8-2a2b-45be-a850-00a40192c511 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.164319 Jul 14 11:25:27.574677 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 414/873] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:27 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:28.048470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:28.049464 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:28.057239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:28.057708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:28.058488 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:28.058927 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:28.087845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5d09c6ce-b5c6-41c2-b423-c0ed2b40f7ed tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043384 Jul 14 11:25:28.088440 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 460/874] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:25:28 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:25:28.099173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:28.099855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:28.106678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:28.107141 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:28.107923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:28.108360 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:28.188008 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] HTTP exception thrown: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 is not attached to volume b6884ff7-481b-4afe-b7ad-2636ba084c15 Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Request method failure captured: Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments/b6884ff7-481b-4afe-b7ad-2636ba084c15 HTTP/1.1 Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_uaMXf_BGq-_zwLJKK9KFeElHOdzct4VUav27zCqMGQzedfGNr3gq2dNgWHhEy12rcfoPnXtfNZcAaS7uLOBQumTlpu5tXo8RH13B5HCaFamjE1yz89GECiU7LP_0BGrYyF4o-pVIwrDJJrJwsf8QqWYSbEmAdH2rKFEKY-cxg2zuY Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 20b87d0f8d1c4ab8a9218ec96872750f Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-TestMinimumBasicScenario-431770321 Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:25:28.195823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_20b87d0f8d1c4ab8a9218ec96872750f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/20b87d0f8d1c4ab8a9218ec96872750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/20b87d0f8d1c4ab8a9218ec96872750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/20b87d0f8d1c4ab8a9218ec96872750f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-TestMinimumBasicScenario-431770321 Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 20b87d0f8d1c4ab8a9218ec96872750f Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-TestMinimumBasicScenario-431770321 Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-TestMinimumBasicScenario-431770321-project Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 41bc56e0e3d0451482572959451ae043 Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-TestMinimumBasicScenario-431770321-project Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:25:28.197509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 is not attached to volume b6884ff7-481b-4afe-b7ad-2636ba084c15 Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'server_id': '685d1643-5aaa-4ffe-9383-ac8338e0f070', 'id': 'b6884ff7-481b-4afe-b7ad-2636ba084c15'} Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b6884ff7-481b-4afe-b7ad-2636ba084c15. Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:25:28.198364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 is not attached to volume b6884ff7-481b-4afe-b7ad-2636ba084c15 Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 is not attached to volume b6884ff7-481b-4afe-b7ad-2636ba084c15 Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:28.200513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Returning 404 to user: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 is not attached to volume b6884ff7-481b-4afe-b7ad-2636ba084c15 {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:25:28.201642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cc02f816-3db2-41a1-b99e-0553164abc2f tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments/b6884ff7-481b-4afe-b7ad-2636ba084c15" status: 404 len: 154 microversion: 2.1 time: 0.103061 Jul 14 11:25:28.201642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 415/875] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:25:28 2022] DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070/os-volume_attachments/b6884ff7-481b-4afe-b7ad-2636ba084c15 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:25:28.580075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-33f2cd7d-ace5-427d-aea8-a8cce7542340 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:28.580683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-33f2cd7d-ace5-427d-aea8-a8cce7542340 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:28.595098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:28.598515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:28.604791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:28.605248 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:28.606123 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:28.606484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:28.641110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-33f2cd7d-ace5-427d-aea8-a8cce7542340 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:28.652608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-33f2cd7d-ace5-427d-aea8-a8cce7542340 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:28.654451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-33f2cd7d-ace5-427d-aea8-a8cce7542340 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:28.656314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-33f2cd7d-ace5-427d-aea8-a8cce7542340 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1282 microversion: 2.20 time: 0.080160 Jul 14 11:25:28.656828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 461/876] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:28 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:28.747869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:28.756968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5c7662ea-c0f4-471c-acc0-13eb9ef06a4a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.167941 Jul 14 11:25:28.757550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 416/877] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:28 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:29.474895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:29.475468 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:29.482750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:29.483239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:29.484027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:29.484467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:29.512469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:25:29.674854 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-35bbe0ea-5525-48ea-ab6d-fa4de4ae570c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:29.675480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-35bbe0ea-5525-48ea-ab6d-fa4de4ae570c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:29.729614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-35bbe0ea-5525-48ea-ab6d-fa4de4ae570c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:29.736839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-35bbe0ea-5525-48ea-ab6d-fa4de4ae570c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:29.738330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-35bbe0ea-5525-48ea-ab6d-fa4de4ae570c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:29.739453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-35bbe0ea-5525-48ea-ab6d-fa4de4ae570c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1282 microversion: 2.20 time: 0.068473 Jul 14 11:25:29.739989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 417/878] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:29 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:25:29.774289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:29.774923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:29.781975 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:29.782419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:29.783230 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:29.783665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:29.805760 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:29.945555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c7364c47-dcc2-41c5-a81d-4ce4ad7a42be tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 204 len: 0 microversion: 2.1 time: 0.473790 Jul 14 11:25:29.946324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 462/879] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:25:29 2022] DELETE /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:25:29.950853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:29.957950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:29.957950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:29.961997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c5a6b74c-8999-42fa-9411-1e133db3e95b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.191511 Jul 14 11:25:29.963194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 418/880] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:29 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:29.965939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:29.966380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:29.967397 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:29.967859 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:30.120710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:30.128651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e9e8b561-4bfe-48d9-8efd-28eef536bbff tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1555 microversion: 2.1 time: 0.177201 Jul 14 11:25:30.129227 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 463/881] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:29 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:30.201475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:25:30.207707 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:25:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:25:30.759415 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:30.761455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:30.767763 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:30.768224 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:30.769049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:30.769492 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:30.835820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:30.844321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:30.845859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:30.846983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9288d476-7543-497d-ba67-9b27abd83e5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1286 microversion: 2.20 time: 0.092346 Jul 14 11:25:30.847570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 419/882] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:30 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:30.983359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:30.983996 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:30.991856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:30.992307 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:30.993128 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:30.994124 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:31.131925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:31.139580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-26858ab3-1da9-4233-b270-2d867e37f10c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1676 microversion: 2.1 time: 0.160179 Jul 14 11:25:31.140566 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 464/883] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:30 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:31.146342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:31.147071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:31.153392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:31.153848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:31.154626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:31.155064 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:31.293126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:31.302147 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-093d4b02-888a-4d22-bfc7-dfeb5c6e5046 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1555 microversion: 2.1 time: 0.159719 Jul 14 11:25:31.302726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 420/884] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:31 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:31.866128 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:31.867165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:31.877686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:31.878226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:31.880507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:31.881240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.157403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:32.157941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:32.165026 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.165527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.166996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.167505 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.178148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:32.202406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:32.210816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:32.213233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-85d4f766-63a7-4fff-82d1-d4dbe064dae2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1278 microversion: 2.20 time: 0.351675 Jul 14 11:25:32.214138 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 465/885] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:31 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:32.224033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-94c0ca36-6ed0-4377-8b81-a6bc330dd79f req-87770c4e-6cb4-4f14-83ea-9b91c69270d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685d1643-5aaa-4ffe-9383-ac8338e0f070", "name": "network-vif-deleted", "tag": "263c0415-7821-4d36-9386-148556baecd3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:32.238045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-94c0ca36-6ed0-4377-8b81-a6bc330dd79f req-87770c4e-6cb4-4f14-83ea-9b91c69270d2 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.238878 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-94c0ca36-6ed0-4377-8b81-a6bc330dd79f req-87770c4e-6cb4-4f14-83ea-9b91c69270d2 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.254213 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-94c0ca36-6ed0-4377-8b81-a6bc330dd79f req-87770c4e-6cb4-4f14-83ea-9b91c69270d2 service nova] Creating event network-vif-deleted:263c0415-7821-4d36-9386-148556baecd3 for instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 on hv-cinder-82282 Jul 14 11:25:32.260375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-94c0ca36-6ed0-4377-8b81-a6bc330dd79f req-87770c4e-6cb4-4f14-83ea-9b91c69270d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043387 Jul 14 11:25:32.261089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 466/886] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:32.321680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:32.323022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:32.330035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.330832 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.331822 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.332492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.336835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:32.345950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bccf2ea0-5ea5-443f-8322-51408b95b48a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1653 microversion: 2.1 time: 0.192545 Jul 14 11:25:32.346536 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 421/887] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:32 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1653 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:32.364132 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8733c34d-118f-43ed-814e-2d63a25b3675 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:32.372554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8733c34d-118f-43ed-814e-2d63a25b3675 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.378193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8733c34d-118f-43ed-814e-2d63a25b3675 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.403557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8733c34d-118f-43ed-814e-2d63a25b3675 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Going to try to start instance {{(pid=118244) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 11:25:32.406217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:32.414150 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-36183d65-1a73-4291-bc51-117f6b431ee9 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1513 microversion: 2.1 time: 0.097208 Jul 14 11:25:32.414665 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 467/888] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:32 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1513 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:32.719799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8733c34d-118f-43ed-814e-2d63a25b3675 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action" status: 202 len: 0 microversion: 2.1 time: 0.359431 Jul 14 11:25:32.720296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 422/889] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:25:32 2022] POST /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:25:32.729413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:32.729766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:32.735854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.736306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.737087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:32.737524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:32.872920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:32.881647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9f03a419-01e8-4fa6-8d36-6e288a84418d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1662 microversion: 2.1 time: 0.156929 Jul 14 11:25:32.892013 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 468/890] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:32 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:33.242871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:33.243715 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:33.250455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.250900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:33.251713 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.252158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:33.346357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:33.354977 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:33.356508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:33.357660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fbb60ef5-e86b-4837-a5f3-024e8a991cd3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1342 microversion: 2.20 time: 0.119603 Jul 14 11:25:33.368611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 423/891] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:33 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1342 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:33.432409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:33.433889 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:33.440444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.440891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:33.441692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.442205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:33.483782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.484256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:33.484722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lazy-loading 'fault' on Instance uuid 685d1643-5aaa-4ffe-9383-ac8338e0f070 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:33.538120 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41bc56e0e3d0451482572959451ae043', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b87d0f8d1c4ab8a9218ec96872750f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:33.546353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-079649cc-a43f-4612-903c-b9cf647d1e40 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 200 len: 1348 microversion: 2.1 time: 0.118310 Jul 14 11:25:33.547225 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 469/892] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:33 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 1348 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:33.900725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:33.901289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:33.908578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.909101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:33.910111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:33.910370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:34.101750 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:34.110742 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2fee69a2-e507-49cb-a58a-0a2e6344d683 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1662 microversion: 2.1 time: 0.215037 Jul 14 11:25:34.111454 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 424/893] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:33 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1662 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:34.377752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:34.378664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:34.385759 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:34.386468 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:34.387697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:34.388231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:34.566722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:34.568333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] [instance: 685d1643-5aaa-4ffe-9383-ac8338e0f070] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:34.575911 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:34.576364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:34.577355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:34.577830 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:34.594129 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] HTTP exception thrown: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 could not be found. Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Request method failure captured: Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 HTTP/1.1 Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_uaMXf_BGq-_zwLJKK9KFeElHOdzct4VUav27zCqMGQzedfGNr3gq2dNgWHhEy12rcfoPnXtfNZcAaS7uLOBQumTlpu5tXo8RH13B5HCaFamjE1yz89GECiU7LP_0BGrYyF4o-pVIwrDJJrJwsf8QqWYSbEmAdH2rKFEKY-cxg2zuY Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 20b87d0f8d1c4ab8a9218ec96872750f Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-TestMinimumBasicScenario-431770321 Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:25:34.595974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_20b87d0f8d1c4ab8a9218ec96872750f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/20b87d0f8d1c4ab8a9218ec96872750f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/20b87d0f8d1c4ab8a9218ec96872750f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/20b87d0f8d1c4ab8a9218ec96872750f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-TestMinimumBasicScenario-431770321 Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 20b87d0f8d1c4ab8a9218ec96872750f Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-TestMinimumBasicScenario-431770321 Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-TestMinimumBasicScenario-431770321-project Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 41bc56e0e3d0451482572959451ae043 Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-TestMinimumBasicScenario-431770321-project Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 could not be found. Jul 14 11:25:34.597427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '685d1643-5aaa-4ffe-9383-ac8338e0f070'} Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 could not be found. Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:25:34.598687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 could not be found. Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 could not be found. Jul 14 11:25:34.600103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:25:34.601210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Returning 404 to user: Instance 685d1643-5aaa-4ffe-9383-ac8338e0f070 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:25:34.601210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6e26d383-293a-40c5-bf74-32af7f7dcfc1 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070" status: 404 len: 111 microversion: 2.1 time: 0.035078 Jul 14 11:25:34.601210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 425/894] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:34 2022] GET /compute/v2.1/servers/685d1643-5aaa-4ffe-9383-ac8338e0f070 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:25:34.611267 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-984d24ae-aa99-4d64-93c0-d3f7f9761163 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] Calling method '.version_select at 0x7f3412b44280>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:34.652719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:34.666757 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:34.668334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:34.669631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-37d9b21d-2d91-402e-9353-38a480931356 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.296923 Jul 14 11:25:34.670133 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 470/895] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:34 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:34.698502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-984d24ae-aa99-4d64-93c0-d3f7f9761163 tempest-TestMinimumBasicScenario-431770321 tempest-TestMinimumBasicScenario-431770321-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1763624318" status: 202 len: 0 microversion: 2.1 time: 0.091408 Jul 14 11:25:34.699088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 426/896] 10.222.0.59 () {58 vars in 1271 bytes} [Thu Jul 14 11:25:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1763624318 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:25:35.134703 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:35.135760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:35.139985 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:35.143802 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:35.144265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:35.145656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:35.145656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:35.294245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-40ccb85a-5500-447f-8e2b-98fa46491b8d req-7651a2f7-798b-49ef-98c6-fc17de50197d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:35.311842 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:35.314878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-40ccb85a-5500-447f-8e2b-98fa46491b8d req-7651a2f7-798b-49ef-98c6-fc17de50197d service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:35.315725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-40ccb85a-5500-447f-8e2b-98fa46491b8d req-7651a2f7-798b-49ef-98c6-fc17de50197d service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:35.339294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-40ccb85a-5500-447f-8e2b-98fa46491b8d req-7651a2f7-798b-49ef-98c6-fc17de50197d service nova] Creating event network-changed:929d3c0f-d941-4817-9998-3cb5f75695d3 for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 on hv-cinder-82282 Jul 14 11:25:35.345919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-40ccb85a-5500-447f-8e2b-98fa46491b8d req-7651a2f7-798b-49ef-98c6-fc17de50197d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058131 Jul 14 11:25:35.352012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 427/897] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:35.372916 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:35.385251 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-82239e1c-84da-4eba-ad8c-67792b9afda4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1662 microversion: 2.1 time: 0.258448 Jul 14 11:25:35.387165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 471/898] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:35 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1662 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:35.689642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:35.690370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:35.698736 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:35.698736 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:35.699305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:35.699585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:35.850684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:35.860314 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:35.861808 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:35.862928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-180e2cde-a18a-44ec-90fa-9ca8094827e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.178133 Jul 14 11:25:35.863523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 428/899] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:35 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:36.404508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:36.405122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:36.411940 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:36.412392 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:36.414503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:36.414503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:36.418346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:36.564543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:36.572866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-208b8363-076f-46fa-a635-8afb6019fd0b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1666 microversion: 2.1 time: 0.173203 Jul 14 11:25:36.573429 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 472/900] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:36 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:36.882523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:36.883166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:36.890788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:36.891728 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:36.892511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:36.893264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:37.029626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:37.037625 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:37.039165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:37.041052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-640c6329-8098-447e-b23f-0c58b2f9bbf2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.162281 Jul 14 11:25:37.041784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 429/901] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:36 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:38.060063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:38.061446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:38.068232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:38.068690 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:38.069479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:38.069925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:38.220355 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:38.231200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:38.232902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:38.234184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-823f0ea6-9903-46ee-846f-86ce6b07959b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.179563 Jul 14 11:25:38.234820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 473/902] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:38 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:39.252446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:39.253065 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:39.260745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:39.261715 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:39.262061 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:39.263111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:39.501711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:39.512033 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:39.513837 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:39.515245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-da09d741-d5f5-4057-a18c-5ba152f3f7ab tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.266775 Jul 14 11:25:39.515910 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 430/903] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:39 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:40.539938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:40.540760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:40.543085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=8 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:40.549460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:40.549917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:40.550708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:40.551168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:40.875871 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:40.884408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:40.886519 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:40.887828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-009fc196-c72c-40a8-ad21-5ffb88056844 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.351950 Jul 14 11:25:40.888476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 474/904] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:40 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:41.906946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:41.907861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:41.910048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=10 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:41.911450 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:41.917130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:41.917739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:41.918954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:41.919522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:42.112097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:42.122721 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:42.124279 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:42.125430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2a597951-3404-43b7-9b85-9aa9f536d46c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.222545 Jul 14 11:25:42.126045 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 431/905] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:41 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:42.284303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-d25b5314-8ca7-41de-a89e-b07bfd88b67d req-621dd1f1-8085-4b3b-8855-027042870af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "name": "network-vif-plugged", "status": "completed", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:42.296044 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d25b5314-8ca7-41de-a89e-b07bfd88b67d req-621dd1f1-8085-4b3b-8855-027042870af3 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:42.296652 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d25b5314-8ca7-41de-a89e-b07bfd88b67d req-621dd1f1-8085-4b3b-8855-027042870af3 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:42.308890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-d25b5314-8ca7-41de-a89e-b07bfd88b67d req-621dd1f1-8085-4b3b-8855-027042870af3 service nova] Creating event network-vif-plugged:929d3c0f-d941-4817-9998-3cb5f75695d3 for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 on hv-cinder-82282 Jul 14 11:25:42.314149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-d25b5314-8ca7-41de-a89e-b07bfd88b67d req-621dd1f1-8085-4b3b-8855-027042870af3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034970 Jul 14 11:25:42.314918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 475/906] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:43.145724 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:43.146520 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:43.155107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:43.156047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:43.156941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:43.157432 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:43.300449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:43.309753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:43.311396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:43.312621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fdc9ffe5-169c-427e-833a-5646aa97c707 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.172087 Jul 14 11:25:43.313374 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 432/907] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:43 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:44.334240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:44.336056 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:44.346135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:44.346919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:44.348302 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:44.349051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:44.609442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:44.619549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:44.622269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:44.623872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f4c48544-855a-48d3-bfbe-ec223a49ae88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1407 microversion: 2.20 time: 0.294906 Jul 14 11:25:44.624196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 476/908] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:44 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:45.641639 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:45.642387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:45.648980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:45.649440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:45.650852 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:45.651333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:45.800723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:45.810039 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:45.811611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:45.812836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9428079d-88ae-4ce5-876f-97b45428a224 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1600 microversion: 2.20 time: 0.175173 Jul 14 11:25:45.816290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 433/909] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:25:45 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:25:45.831175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:45.831962 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:45.839974 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:45.840730 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:45.842050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:45.842779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:45.927919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-48f8bcac-b24e-442a-8792-d507e30385ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100611 Jul 14 11:25:45.928613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 477/910] 10.222.0.59 () {60 vars in 1315 bytes} [Thu Jul 14 11:25:45 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:25:47.414041 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-507a89a8-b896-4c75-926d-310d4079ce26 req-22117285-998e-46c4-b94c-fe0b87799fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:47.423983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-507a89a8-b896-4c75-926d-310d4079ce26 req-22117285-998e-46c4-b94c-fe0b87799fa0 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:47.424437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-507a89a8-b896-4c75-926d-310d4079ce26 req-22117285-998e-46c4-b94c-fe0b87799fa0 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:47.436788 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-507a89a8-b896-4c75-926d-310d4079ce26 req-22117285-998e-46c4-b94c-fe0b87799fa0 service nova] Creating event network-changed:929d3c0f-d941-4817-9998-3cb5f75695d3 for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 on hv-cinder-82282 Jul 14 11:25:47.442035 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-507a89a8-b896-4c75-926d-310d4079ce26 req-22117285-998e-46c4-b94c-fe0b87799fa0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032371 Jul 14 11:25:47.443202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 434/911] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:48.588817 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:48.590724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:48.602205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:48.602544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:48.604926 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:48.605760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:48.715205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'services' on Instance uuid a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:48.995937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-04c9a3a9-5883-4c82-ba5d-2ac5f0652437 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments/2a7c7c1a-0ea6-4be7-af4f-7005b2482080" status: 202 len: 0 microversion: 2.1 time: 0.416273 Jul 14 11:25:48.996837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 478/912] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:25:48 2022] DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments/2a7c7c1a-0ea6-4be7-af4f-7005b2482080 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:25:49.016442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:49.018392 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:49.034121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:49.034121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:49.034121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:49.034121 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:49.084463 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5f08dff0-3264-4308-a32c-cabf897e37cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079889 Jul 14 11:25:49.085045 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 435/913] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:25:49 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:25:50.104843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:50.106032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:50.114331 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:50.119390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:50.119390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:50.119390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:50.154235 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6e7ebca1-0853-4b9b-ac0f-6235c7e63e51 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055165 Jul 14 11:25:50.154810 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 479/914] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:25:50 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:51.175530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:51.175530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:51.175530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:51.176241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:51.176574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:51.177018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:51.207048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-44b4ac50-c5f5-427c-9ef8-fdd5016924b9 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044372 Jul 14 11:25:51.207813 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 436/915] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:25:51 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:25:51.301150 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:51.302058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:51.312950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:51.313594 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:51.314466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:51.314920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:51.352674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:25:51.762555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0753d9be-1484-4139-be26-d54a84c404cd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 204 len: 0 microversion: 2.1 time: 0.466955 Jul 14 11:25:51.763612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 480/916] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:25:51 2022] DELETE /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:25:51.773035 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:51.773665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:51.780740 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:51.781229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:51.782003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:51.785872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:51.786973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:52.035222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:52.069173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9b574694-fc86-4686-b388-49fd474822f0 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1691 microversion: 2.1 time: 0.299907 Jul 14 11:25:52.075495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 437/917] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:51 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1691 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:53.091697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:53.092403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:53.101885 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:53.102358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:53.103716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:53.104156 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:53.326614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:53.336689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-acd9c651-df5f-4212-9932-78174b243a20 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1691 microversion: 2.1 time: 0.249089 Jul 14 11:25:53.337141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 481/918] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:53 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1691 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:25:54.356687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:54.358040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:54.372243 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:54.377329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:54.381342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:54.382217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:54.631839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:54.654464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-52bd12f1-dc25-4dd4-bcde-a82fc2a6ee74 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1691 microversion: 2.1 time: 0.303223 Jul 14 11:25:54.655393 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 438/919] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:54 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:55.721163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:55.721163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:55.721163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:55.721163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:55.722657 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:55.722657 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:55.918963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:55.928795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cbd22a9a-3fef-43c0-80f3-d71f38c93b21 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1691 microversion: 2.1 time: 0.253747 Jul 14 11:25:55.929306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 482/920] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:55 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:56.783999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-ebc908f5-d3bc-498d-a974-f18bea28cb1a req-420d0997-ea18-41b3-b4ff-99feed98f709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64a13ae-3a63-4bdd-8113-cf2e9b4b3588", "name": "network-vif-deleted", "tag": "46cab31c-2d94-46c2-a19b-9b2357606b0b"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:25:56.819758 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-ebc908f5-d3bc-498d-a974-f18bea28cb1a req-420d0997-ea18-41b3-b4ff-99feed98f709 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:56.820499 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-ebc908f5-d3bc-498d-a974-f18bea28cb1a req-420d0997-ea18-41b3-b4ff-99feed98f709 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:56.845654 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-ebc908f5-d3bc-498d-a974-f18bea28cb1a req-420d0997-ea18-41b3-b4ff-99feed98f709 service nova] Creating event network-vif-deleted:46cab31c-2d94-46c2-a19b-9b2357606b0b for instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 on hv-cinder-82282 Jul 14 11:25:56.865564 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-ebc908f5-d3bc-498d-a974-f18bea28cb1a req-420d0997-ea18-41b3-b4ff-99feed98f709 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087789 Jul 14 11:25:56.867572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 439/921] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:25:56.950315 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:56.952386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:56.969438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:56.973304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:56.974705 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:56.975364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:57.136144 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:57.145208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e1fdefb6-a55e-41ff-afad-a52205d8afba tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1331 microversion: 2.1 time: 0.201032 Jul 14 11:25:57.148634 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 483/922] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:56 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1331 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:58.167316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:58.169175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:58.196366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:58.197649 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:58.198799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:58.199435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:58.260077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:58.260077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:58.260077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'fault' on Instance uuid a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:25:58.354958 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:25:58.364968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1b970150-e478-4253-92e4-4f8a4ba83783 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 200 len: 1336 microversion: 2.1 time: 0.203191 Jul 14 11:25:58.375506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 440/923] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:58 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 1336 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:25:59.393755 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:59.395736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a64a13ae-3a63-4bdd-8113-cf2e9b4b3588] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:25:59.405843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:59.406045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:59.406831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:25:59.407330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:25:59.426811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] HTTP exception thrown: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 could not be found. Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Request method failure captured: Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 HTTP/1.1 Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s4s8eZc0yEZA9xVxWy755FnwSggKF-HEBU84sm1M6JV9jHFOV4lg2ORyRU_7Y9BQtsfqnMAudUP2ADsfzx18NKuuxncTH6tMPlf8sqB5Sk_7a3IhAYCkGzEuQGXNOZ7xuY-_VTtM8oWs_Lx7t_tW8qsGf5EBfBGZdPYLiBNHTScHY Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:25:59.428934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_08cc50e4caea44e2a2bb1413a35e3b6d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: e3e8aa5fc932453e95080fa836dfac0c Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 could not be found. Jul 14 11:25:59.430612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'a64a13ae-3a63-4bdd-8113-cf2e9b4b3588'} Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 could not be found. Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:25:59.431725 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 could not be found. Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 could not be found. Jul 14 11:25:59.434123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:25:59.435975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Returning 404 to user: Instance a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:25:59.435975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-61d44ea0-4879-41d5-9e1f-b29f148a6411 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588" status: 404 len: 111 microversion: 2.1 time: 0.046082 Jul 14 11:25:59.436623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 484/924] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:25:59 2022] GET /compute/v2.1/servers/a64a13ae-3a63-4bdd-8113-cf2e9b4b3588 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:25:59.441924 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6d4d58b9-3bf9-4ebd-8f99-896168b9cdb8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '.version_select at 0x7f3412ebb820>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:25:59.548452 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6d4d58b9-3bf9-4ebd-8f99-896168b9cdb8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442404034" status: 202 len: 0 microversion: 2.1 time: 0.110507 Jul 14 11:25:59.549036 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 441/925] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jul 14 11:25:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442404034 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:26:03.443596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-94a53310-1d9b-442b-828a-c1f155b015f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Action: 'create', calling method: .version_select at 0x7f34122fe430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1262803912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0SI3rKZoB3Xvn5PB+fVAjYpfWkjmvmePWlxwKYV7G9wcWpaRKISOPVAXbKN6I1G5LJwkRlU4tx1Vh0wto7XlDEQ2XutsAnouQgAoZloqaIbGi1cZdrSVN67/aN1+GE9A=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:03.458111 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-94a53310-1d9b-442b-828a-c1f155b015f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for project f3904fb55e2e463fb548333d97601ce5. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:26:03.461975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-94a53310-1d9b-442b-828a-c1f155b015f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for user c466157931bd41baabb01abbec492b4f and project f3904fb55e2e463fb548333d97601ce5. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:26:03.529325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:03.529833 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:03.536092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:03.536550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:03.537330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:03.537764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:03.565689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:26:03.607693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-94a53310-1d9b-442b-828a-c1f155b015f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.349823 Jul 14 11:26:03.608391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 485/926] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:26:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:03.878347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5b42e97e-4789-4523-981c-738210749bd5 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 204 len: 0 microversion: 2.1 time: 0.354151 Jul 14 11:26:03.879288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 442/927] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:26:03 2022] DELETE /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:26:03.892737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:03.894322 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:03.905382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:03.906508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:03.908312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:03.908870 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:04.096231 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:04.106699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-672d4aa9-5df5-4760-88d8-a6a61c1db8dd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1508 microversion: 2.1 time: 0.222862 Jul 14 11:26:04.108254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 486/928] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:03 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:05.125277 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:05.126565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:05.137971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:05.138431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:05.139287 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:05.139918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:05.306817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:05.318234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5d580868-584a-4bc9-a367-84a29be80f81 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1508 microversion: 2.1 time: 0.194459 Jul 14 11:26:05.318234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 443/929] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:05 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:05.563108 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-d1d9ed1e-1df7-4f74-91c2-b0376f5b710f req-595b899c-5db9-48d4-ae07-ceb39974348b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a714690c-6862-4797-8c84-e07c9262c217", "name": "network-vif-deleted", "tag": "bff12a73-9dcb-415a-be41-a46436a20db6"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:05.573908 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d1d9ed1e-1df7-4f74-91c2-b0376f5b710f req-595b899c-5db9-48d4-ae07-ceb39974348b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:05.574352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-d1d9ed1e-1df7-4f74-91c2-b0376f5b710f req-595b899c-5db9-48d4-ae07-ceb39974348b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:05.588000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-d1d9ed1e-1df7-4f74-91c2-b0376f5b710f req-595b899c-5db9-48d4-ae07-ceb39974348b service nova] Creating event network-vif-deleted:bff12a73-9dcb-415a-be41-a46436a20db6 for instance a714690c-6862-4797-8c84-e07c9262c217 on hv-cinder-82282 Jul 14 11:26:05.594226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-d1d9ed1e-1df7-4f74-91c2-b0376f5b710f req-595b899c-5db9-48d4-ae07-ceb39974348b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034634 Jul 14 11:26:05.594845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 487/930] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:06.335460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:06.336153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:06.345491 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:06.346016 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:06.346902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:06.347396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:06.384959 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:06.386397 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:06.387178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'fault' on Instance uuid a714690c-6862-4797-8c84-e07c9262c217 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:26:06.437660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:06.452256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-572d8af1-b22c-47dd-8b7b-85a3e775b0f2 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 200 len: 1311 microversion: 2.1 time: 0.121156 Jul 14 11:26:06.452851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 444/931] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:06 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:07.475544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:07.476430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: a714690c-6862-4797-8c84-e07c9262c217] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:07.479931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:07.485311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:07.485883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:07.486676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:07.487206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:07.507096 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] HTTP exception thrown: Instance a714690c-6862-4797-8c84-e07c9262c217 could not be found. Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Request method failure captured: Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 HTTP/1.1 Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s4s8eZc0yEZA9xVxWy755FnwSggKF-HEBU84sm1M6JV9jHFOV4lg2ORyRU_7Y9BQtsfqnMAudUP2ADsfzx18NKuuxncTH6tMPlf8sqB5Sk_7a3IhAYCkGzEuQGXNOZ7xuY-_VTtM8oWs_Lx7t_tW8qsGf5EBfBGZdPYLiBNHTScHY Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:26:07.508779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_08cc50e4caea44e2a2bb1413a35e3b6d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: e3e8aa5fc932453e95080fa836dfac0c Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance a714690c-6862-4797-8c84-e07c9262c217 could not be found. Jul 14 11:26:07.511032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'a714690c-6862-4797-8c84-e07c9262c217'} Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a714690c-6862-4797-8c84-e07c9262c217 could not be found. Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:26:07.511826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a714690c-6862-4797-8c84-e07c9262c217 could not be found. Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a714690c-6862-4797-8c84-e07c9262c217 could not be found. Jul 14 11:26:07.513039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:07.514131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Returning 404 to user: Instance a714690c-6862-4797-8c84-e07c9262c217 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:26:07.514131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-399b6f55-7de0-4033-9a68-e53453b2b8c8 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217" status: 404 len: 111 microversion: 2.1 time: 0.041394 Jul 14 11:26:07.514131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 488/932] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:07 2022] GET /compute/v2.1/servers/a714690c-6862-4797-8c84-e07c9262c217 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:26:07.521281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:07.521878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:07.529521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:07.529521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:07.530344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:07.530787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:07.565141 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:26:07.979719 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f8867919-e092-428a-ae5b-99f4aa3a208e tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 204 len: 0 microversion: 2.1 time: 0.461932 Jul 14 11:26:07.980837 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 445/933] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:26:07 2022] DELETE /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:26:07.994848 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:07.995852 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:08.006936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:08.007752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:08.009010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:08.009718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:08.228695 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:08.231519 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:08.243369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d8cebd58-ab46-494a-921c-fbe1a38109d7 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.256899 Jul 14 11:26:08.247166 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 489/934] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:07 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:09.277239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:09.277954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:09.286603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:09.287207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:09.288105 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:09.288599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:09.481014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:09.490876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d00c945f-2048-48f7-b0e7-510b999d32bd tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1522 microversion: 2.1 time: 0.220086 Jul 14 11:26:09.491999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 446/935] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:09 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:10.088921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-40f53b42-7664-492d-bd5d-b34784bd5a7d req-615883eb-1ae2-4c2f-8cda-6f8ca73b6377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f384cec4-20d3-4f6d-aeee-62ee2b5abe41", "name": "network-vif-deleted", "tag": "4e9f5953-94dc-4311-8014-999286bdb480"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:10.100373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-40f53b42-7664-492d-bd5d-b34784bd5a7d req-615883eb-1ae2-4c2f-8cda-6f8ca73b6377 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:10.112217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-40f53b42-7664-492d-bd5d-b34784bd5a7d req-615883eb-1ae2-4c2f-8cda-6f8ca73b6377 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:10.114765 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-40f53b42-7664-492d-bd5d-b34784bd5a7d req-615883eb-1ae2-4c2f-8cda-6f8ca73b6377 service nova] Creating event network-vif-deleted:4e9f5953-94dc-4311-8014-999286bdb480 for instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 on hv-cinder-82282 Jul 14 11:26:10.125488 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-40f53b42-7664-492d-bd5d-b34784bd5a7d req-615883eb-1ae2-4c2f-8cda-6f8ca73b6377 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 Jul 14 11:26:10.126492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 490/936] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:10.516538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:10.517704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:10.525806 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:10.526329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:10.527340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:10.527868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:10.573326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:10.573779 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:10.574343 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lazy-loading 'fault' on Instance uuid f384cec4-20d3-4f6d-aeee-62ee2b5abe41 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:26:10.619542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3e8aa5fc932453e95080fa836dfac0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08cc50e4caea44e2a2bb1413a35e3b6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:10.630418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e9b3f952-c055-45fc-a0f9-363cc7117b56 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 200 len: 1312 microversion: 2.1 time: 0.119072 Jul 14 11:26:10.631269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 447/937] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:10 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:11.654046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:11.654857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] [instance: f384cec4-20d3-4f6d-aeee-62ee2b5abe41] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:11.662280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:11.662737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:11.663544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:11.663982 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:11.679914 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] HTTP exception thrown: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 could not be found. Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Request method failure captured: Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 HTTP/1.1 Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s4s8eZc0yEZA9xVxWy755FnwSggKF-HEBU84sm1M6JV9jHFOV4lg2ORyRU_7Y9BQtsfqnMAudUP2ADsfzx18NKuuxncTH6tMPlf8sqB5Sk_7a3IhAYCkGzEuQGXNOZ7xuY-_VTtM8oWs_Lx7t_tW8qsGf5EBfBGZdPYLiBNHTScHY Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:26:11.682646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_08cc50e4caea44e2a2bb1413a35e3b6d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/08cc50e4caea44e2a2bb1413a35e3b6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 08cc50e4caea44e2a2bb1413a35e3b6d Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122959956 Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: e3e8aa5fc932453e95080fa836dfac0c Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122959956-project Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 could not be found. Jul 14 11:26:11.685508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'f384cec4-20d3-4f6d-aeee-62ee2b5abe41'} Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 could not be found. Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:26:11.686768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 could not be found. Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 could not be found. Jul 14 11:26:11.688343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:11.690055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] Returning 404 to user: Instance f384cec4-20d3-4f6d-aeee-62ee2b5abe41 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:26:11.690055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cf74f52e-cc4c-4d56-96f8-bbfda4f460e6 tempest-ServerRescueNegativeTestJSON-2122959956 tempest-ServerRescueNegativeTestJSON-2122959956-project] 10.222.0.59 "GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41" status: 404 len: 111 microversion: 2.1 time: 0.035603 Jul 14 11:26:11.690055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 491/938] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:11 2022] GET /compute/v2.1/servers/f384cec4-20d3-4f6d-aeee-62ee2b5abe41 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:26:18.473065 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-05004b89-0ea0-4249-8029-a56ae1ab7f19 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Action: 'create', calling method: .version_select at 0x7f3412b573a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1299017783", "metadata": {"Type": "work"}}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:19.280149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-05004b89-0ea0-4249-8029-a56ae1ab7f19 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.939541 Jul 14 11:26:19.280879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 448/939] 10.222.0.59 () {60 vars in 1155 bytes} [Thu Jul 14 11:26:18 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 941 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 11:26:19.297035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-46acd654-47a8-4c49-8b89-1b0627105f1f tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f34123eaa60>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:19.308249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=4 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:19.355664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-46acd654-47a8-4c49-8b89-1b0627105f1f tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 200 len: 353 microversion: 2.1 time: 0.067126 Jul 14 11:26:19.356480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 492/940] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:26:19 2022] GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:20.370785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8251afaf-6fd9-47fc-96da-75ba25ea1348 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f3412b4e1f0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:20.423810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8251afaf-6fd9-47fc-96da-75ba25ea1348 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 200 len: 353 microversion: 2.1 time: 0.057642 Jul 14 11:26:20.424391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 449/941] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:26:20 2022] GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:21.441337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5688a521-b9c5-48ff-97d4-18f32c769311 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f3412254a60>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:21.497424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5688a521-b9c5-48ff-97d4-18f32c769311 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 200 len: 354 microversion: 2.1 time: 0.061956 Jul 14 11:26:21.497990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 493/942] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:26:21 2022] GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:21.506070 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:21.506913 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:21.512472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b032ba90-36b5-475a-ab8c-81afc8d77b7c tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f3412b07670>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:21.565094 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b032ba90-36b5-475a-ab8c-81afc8d77b7c tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 200 len: 354 microversion: 2.1 time: 0.059788 Jul 14 11:26:21.565736 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 450/943] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:26:21 2022] GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:21.583360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-04c9d762-96a3-4186-ae8f-8a2cb52995c1 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f341221f940>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:21.659280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=7 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:21.898198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-04c9d762-96a3-4186-ae8f-8a2cb52995c1 tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 202 len: 0 microversion: 2.1 time: 0.318676 Jul 14 11:26:21.898865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 494/944] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:26:21 2022] DELETE /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:26:21.907798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-94398268-3828-449a-84c5-2e243c938c0e tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f3412b4eca0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:21.967880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-94398268-3828-449a-84c5-2e243c938c0e tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 200 len: 353 microversion: 2.1 time: 0.064553 Jul 14 11:26:21.968478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 451/945] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:26:21 2022] GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:22.981988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-795c3f88-32e4-4b00-95f2-b66f4c33ad2b tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Calling method '.version_select at 0x7f3412254a60>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:23.010762 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-795c3f88-32e4-4b00-95f2-b66f4c33ad2b tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] HTTP exception thrown: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-795c3f88-32e4-4b00-95f2-b66f4c33ad2b tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Request method failure captured: Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 HTTP/1.1 Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_1a7mt7JDSI2HU83CnN9tRITLK3azKUZW29k2T8Kor61L0ngNS3XtWYnJOcbYRf889gXCXMMo47MqAAkGvZhQYIk3pZieJLdkcps28AQFblmxWK6pFHQ8h_k7XZt_luz743NBkeErhUuqAuoYY-nqU8J4MM5tXIkwb4dERsgmhYp-8 Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 027a4768ba6a4d3f8967481442622a2d Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-VolumesGetTestJSON-976179619 Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:26:23.012993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_027a4768ba6a4d3f8967481442622a2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/027a4768ba6a4d3f8967481442622a2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/027a4768ba6a4d3f8967481442622a2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/027a4768ba6a4d3f8967481442622a2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-VolumesGetTestJSON-976179619 Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 027a4768ba6a4d3f8967481442622a2d Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-VolumesGetTestJSON-976179619 Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-VolumesGetTestJSON-976179619-project Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 33a5edf467d340338cea978e2f86eb75 Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-VolumesGetTestJSON-976179619-project Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'a852462c-a663-4ee4-be95-84e7a6fc1671'} Jul 14 11:26:23.014754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. (HTTP 404) (Request-ID: req-dea38436-79de-4029-8101-f34a88f0650e) Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:23.015884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 11:26:23.017767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 11:26:23.019531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-795c3f88-32e4-4b00-95f2-b66f4c33ad2b tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] Returning 404 to user: Volume a852462c-a663-4ee4-be95-84e7a6fc1671 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-795c3f88-32e4-4b00-95f2-b66f4c33ad2b tempest-VolumesGetTestJSON-976179619 tempest-VolumesGetTestJSON-976179619-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671" status: 404 len: 109 microversion: 2.1 time: 0.037717 Jul 14 11:26:23.021265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 495/946] 10.222.0.59 () {58 vars in 1244 bytes} [Thu Jul 14 11:26:22 2022] GET /compute/v2.1/os-volumes/a852462c-a663-4ee4-be95-84e7a6fc1671 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:26:28.548131 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:28.548698 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:28.555652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:28.556140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:28.556893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:28.557372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:28.582856 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lazy-loading 'flavor' on Instance uuid 1b0fba6f-83bc-468c-aca3-c00c0a31611c {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:26:29.158184 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a2c76450-7db6-4300-921f-12011a8b08c8 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "POST /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c/action" status: 202 len: 0 microversion: 2.1 time: 0.616369 Jul 14 11:26:29.158912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 452/947] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:26:28 2022] POST /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:26:29.168995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:29.171015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:29.182966 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:29.183476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:29.184270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:29.184713 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:29.322142 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:29.330711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-48ac2c79-2581-493a-810a-48d1eebd34b5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.167451 Jul 14 11:26:29.332017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 496/948] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:29 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:30.348620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:30.349229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:30.355904 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:30.356362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:30.357139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:30.357582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:30.507417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:30.518866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-66ff7c20-145a-47c2-ae58-cdc0eea8911d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.174951 Jul 14 11:26:30.519501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 453/949] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:30 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:31.711587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:31.712453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:31.719805 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:31.720295 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:31.721119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:31.721646 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:31.871552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:31.876438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8cc868e7-0867-4c28-a0ad-c56c15b5ac67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.343183 Jul 14 11:26:31.877008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 497/950] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:31 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:32.893916 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:32.894587 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:32.901987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:32.902460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:32.903245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:32.903699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:33.049119 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:33.057004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b5c2306a-df18-46ea-b954-a5ee437281d9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.166744 Jul 14 11:26:33.058097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 454/951] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:32 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:34.081430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:34.081430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:34.081981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:34.082348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:34.083170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:34.083613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:34.250178 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:34.258764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-91bc8552-ab6a-4e5c-b44c-fbf78fb7f647 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.188846 Jul 14 11:26:34.259509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 498/952] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:34 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:34.404430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-177461571", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1262803912", "security_groups": [{"name": "tempest-secgroup-smoke-1603179061"}], "block_device_mapping_v2": [{"uuid": "339daa40-2cb7-4589-b2e4-9fb6dc1f0265", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dcd81d06-0465-420e-871c-9fad1baf38d1"}]}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:34.522308 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] validate_networks() for [('dcd81d06-0465-420e-871c-9fad1baf38d1', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:26:35.002081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:26:35.002563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:26:35.003077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:26:35.003554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:26:35.003969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:26:35.013956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:35.014400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:35.015231 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:35.015682 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:35.033727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for project f3904fb55e2e463fb548333d97601ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:26:35.037903 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for user c466157931bd41baabb01abbec492b4f and project f3904fb55e2e463fb548333d97601ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:26:35.098114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:26:35.100359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='339daa40-2cb7-4589-b2e4-9fb6dc1f0265',volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:26:35.277212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:35.278037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:35.284365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:35.284811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:35.285583 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:35.286022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:35.425066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:35.433253 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-74b870fd-f8d2-4333-92c3-f14dec23bbb6 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.159818 Jul 14 11:26:35.433739 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 499/953] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:35 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:35.615032 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6d1019a9-2f94-49fc-94b6-5a294bd94f76 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.215055 Jul 14 11:26:35.624408 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 455/954] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:26:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:26:35.629656 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-57247687-335f-49d9-b6d5-57c33a8f167e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:35.630400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-57247687-335f-49d9-b6d5-57c33a8f167e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:35.687989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-57247687-335f-49d9-b6d5-57c33a8f167e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:35.696997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-57247687-335f-49d9-b6d5-57c33a8f167e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1094 microversion: 2.1 time: 0.070490 Jul 14 11:26:35.698322 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 500/955] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:35 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:36.452191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:36.452807 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:36.460037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:36.460498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:36.461289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:36.461726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:36.605975 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:36.613865 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f1ced6fb-468b-4f8a-8c9c-cf91c9742144 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.166135 Jul 14 11:26:36.614552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 456/956] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:36 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:36.715668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-044d4a1c-8132-45c0-8a20-d2a8a2bf0571 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:36.716296 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-044d4a1c-8132-45c0-8a20-d2a8a2bf0571 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:36.770674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-044d4a1c-8132-45c0-8a20-d2a8a2bf0571 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:36.777878 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-044d4a1c-8132-45c0-8a20-d2a8a2bf0571 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1094 microversion: 2.1 time: 0.067272 Jul 14 11:26:36.778435 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 501/957] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:36 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:37.633930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:37.634850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:37.643054 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:37.643536 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:37.644320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:37.644769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:37.804753 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:37.805016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:37.805016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:37.812073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-298ae0a4-e5aa-4c8e-9ee4-86fdc9c592ad tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.183298 Jul 14 11:26:37.812698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:37.814466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 457/958] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:37 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:37.828068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:37.829741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:37.830423 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:38.196858 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:38.207055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-83ef45b8-04a7-4df2-9a8a-33db27b551ed tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1192 microversion: 2.1 time: 0.408251 Jul 14 11:26:38.207677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 502/959] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:37 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1192 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:38.835325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:38.836323 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:38.846599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:38.848611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:38.848611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:38.848611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:39.011008 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:39.020227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b5040af2-25c6-4bc3-91f4-47bed75ed4f4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.191084 Jul 14 11:26:39.021344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 458/960] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:38 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:39.226726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:39.228157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:39.238711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:39.239417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:39.240466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:39.240931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:39.425821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:39.440372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b1b8607e-bb45-4973-af8e-4c8c46d36928 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1278 microversion: 2.1 time: 0.214362 Jul 14 11:26:39.440372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 503/961] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:39 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:40.040176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:40.042285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:40.049610 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.050118 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.050912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.051379 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.294933 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:40.312790 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cc53b74c-c4b5-423e-b944-eb57e440b25a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.274261 Jul 14 11:26:40.313836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 459/962] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:40 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:40.452964 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:40.453589 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:40.461413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.462074 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.463149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.464450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.531631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-319eff40-f5f3-41bb-9e8b-862a89cafb86 req-0101a9d3-634f-4c24-b4c4-11ae32ba73d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beae9bb-3e63-453f-9262-7d2b446ea357", "tag": "b634c1af-ed40-40e7-a037-e3aa95ce980e"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:40.549081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-319eff40-f5f3-41bb-9e8b-862a89cafb86 req-0101a9d3-634f-4c24-b4c4-11ae32ba73d9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:40.549530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-319eff40-f5f3-41bb-9e8b-862a89cafb86 req-0101a9d3-634f-4c24-b4c4-11ae32ba73d9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:40.564132 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-319eff40-f5f3-41bb-9e8b-862a89cafb86 req-0101a9d3-634f-4c24-b4c4-11ae32ba73d9 service nova] Creating event network-changed:b634c1af-ed40-40e7-a037-e3aa95ce980e for instance 1beae9bb-3e63-453f-9262-7d2b446ea357 on hv-cinder-82282 Jul 14 11:26:40.569633 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-319eff40-f5f3-41bb-9e8b-862a89cafb86 req-0101a9d3-634f-4c24-b4c4-11ae32ba73d9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045253 Jul 14 11:26:40.570984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 460/963] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:40.702470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:40.710837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-26a10b0e-a0f4-4aa9-ace6-972478c88a10 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.261937 Jul 14 11:26:40.711460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 504/964] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:40 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:41.332317 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:41.332317 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:41.339894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:41.343671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:41.343671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:41.343671 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:41.490477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:41.501386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dc35a42f-26b6-4859-97a7-270af2cc361d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.174460 Jul 14 11:26:41.501820 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 461/965] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:41 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:41.728624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:41.729824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:41.737121 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:41.737577 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:41.738651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:41.739075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:41.905708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:41.913943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dd08679f-9175-40d2-bc15-64cc992316a7 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.189410 Jul 14 11:26:41.914505 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 505/966] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:41 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:42.521017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:42.521637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:42.529059 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:42.529473 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:42.530254 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:42.530690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:42.675562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:42.684506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-972132ef-c3d8-465d-bc96-031fc16d1cd4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.168137 Jul 14 11:26:42.689351 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 462/967] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:42 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:42.931718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:42.932395 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:42.938981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:42.941401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:42.941401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:42.941401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:43.083785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:43.092640 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e3bebc95-0836-43ea-82a6-02ca7d2b6e3c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.165070 Jul 14 11:26:43.093199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 506/968] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:42 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:43.702960 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:43.703669 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:43.710216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:43.710665 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:43.711533 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:43.711973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:43.854907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:43.862663 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-14e423e3-8c04-4707-8b1a-994eb6d6e8e5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.163685 Jul 14 11:26:43.863257 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 463/969] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:43 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:44.109807 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:44.110419 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:44.120387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:44.120387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:44.120387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:44.120754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:44.266783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:44.274460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-99b58abf-ee88-4fde-a2a1-331e8c47338c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.168869 Jul 14 11:26:44.275012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 507/970] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:44 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:44.881013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:44.881565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:44.888370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:44.888836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:44.889611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:44.890042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.024011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:45.037260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:45.039902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dbba1a2b-125e-4ea5-99a4-cf2f7cede979 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1567 microversion: 2.1 time: 0.163047 Jul 14 11:26:45.040706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 464/971] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:44 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:45.060703 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:45.061323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:45.067567 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:45.068015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.068780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:45.069209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.292438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:45.293218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:45.295013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:45.300291 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:45.301652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.301652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:45.301907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.400170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c810dd16-806e-4493-9ee9-0b8e92a93584 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "POST /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c/action" status: 202 len: 0 microversion: 2.1 time: 0.343864 Jul 14 11:26:45.401770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 508/972] 10.222.0.59 () {60 vars in 1277 bytes} [Thu Jul 14 11:26:45 2022] POST /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:26:45.409557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:45.410266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:45.417566 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:45.418289 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.419281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:45.419721 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:45.453947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:45.461866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f2cb06af-8826-4f82-862a-417e0b3d2485 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.174228 Jul 14 11:26:45.474604 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 465/973] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:45 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:45.559650 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:45.567467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7e912385-1c93-4a47-97a7-58164c30f75e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1515 microversion: 2.1 time: 0.162215 Jul 14 11:26:45.568119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 509/974] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:45 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:46.480583 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:46.481965 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:46.488666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.489255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.490021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.490502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.520214 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-1f55f83f-7ada-4298-8ba7-56cb73967a6a req-9201d552-91bd-48fd-a729-fe1493d69dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "name": "network-vif-unplugged", "status": "completed", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:46.530245 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-1f55f83f-7ada-4298-8ba7-56cb73967a6a req-9201d552-91bd-48fd-a729-fe1493d69dd5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.530691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-1f55f83f-7ada-4298-8ba7-56cb73967a6a req-9201d552-91bd-48fd-a729-fe1493d69dd5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.542817 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.compute.server_external_events [req-1f55f83f-7ada-4298-8ba7-56cb73967a6a req-9201d552-91bd-48fd-a729-fe1493d69dd5 service nova] Unable to find a host for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c. Dropping event network-vif-unplugged {{(pid=118245) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 11:26:46.543740 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-1f55f83f-7ada-4298-8ba7-56cb73967a6a req-9201d552-91bd-48fd-a729-fe1493d69dd5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028098 Jul 14 11:26:46.544582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 510/975] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 11:26:46.586133 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:46.586746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:46.594075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.596391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.596391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:46.596391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:46.638284 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:46.650286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b5ab020a-f7bf-408c-8b93-3695f7b78039 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.175028 Jul 14 11:26:46.651810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 466/976] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:46 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:46.756223 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:46.765022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-dce23dc4-39f2-4c97-89b2-fcfcd8bf3be2 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1515 microversion: 2.1 time: 0.183102 Jul 14 11:26:46.765779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 511/977] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:46 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:47.668691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:47.669482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:47.676389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.676846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.677636 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.678082 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.782218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:47.783475 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:47.788673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=4 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:47.791814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.792313 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.793873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:47.794712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:47.832000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:47.835441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:47.840773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bba7cd65-da08-4aad-a0e6-e49499265ee1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.176174 Jul 14 11:26:47.850670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 467/978] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:47 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:47.984830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:47.992645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-873a3285-2175-4f50-a536-18738bf8c868 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1517 microversion: 2.1 time: 0.214475 Jul 14 11:26:47.993222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 512/979] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:47 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:48.858616 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:48.859244 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:48.866432 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:48.866878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:48.867739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:48.868120 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:49.011526 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:49.012729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:49.021280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:49.027760 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:49.027933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:49.027933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:49.027933 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:49.031091 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ef608973-395b-4e18-a78f-d82213d274ae tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.176197 Jul 14 11:26:49.031091 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 468/980] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:48 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:49.045369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:49.223753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:49.232532 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d8a45c39-f719-4e67-99ed-3620f9e96592 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.225188 Jul 14 11:26:49.233126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 513/981] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:49 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:50.050013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:50.050013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:50.063626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:50.064165 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:50.065066 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:50.065537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:50.223460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:50.231316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-84cca1e7-7414-4f4b-a886-a04b390c00f0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.187047 Jul 14 11:26:50.231906 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 469/982] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:50 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:50.250353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:50.250976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:50.258306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:50.258783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:50.259689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:50.260116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:50.401514 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:50.409706 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9656fd45-8973-4976-a390-f12284420e8a tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.164161 Jul 14 11:26:50.410281 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 514/983] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:50 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:51.253561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:51.254739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:51.266051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:51.266776 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:51.268131 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:51.268907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:51.411864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:51.419848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2ed457e1-7b10-41f9-8481-b67b43d6cee8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.174319 Jul 14 11:26:51.420655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 470/984] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:51 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:51.485170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:51.485967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:51.492334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:51.492709 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:51.493490 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:51.493930 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:51.637723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:51.649238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-335a9b60-0f91-4e0b-bf4f-ace29844358d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.168750 Jul 14 11:26:51.649951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 515/985] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:51 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:52.441087 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:52.441776 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:52.451590 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:52.452307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:52.453072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:52.453532 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:52.602012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:52.609999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-14df7aa7-bb64-466c-8c84-d7903616a7ee tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.176937 Jul 14 11:26:52.619234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 471/986] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:52 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:52.673057 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:52.673623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:52.676205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=47 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:52.681044 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:52.681497 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:52.682269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:52.682712 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:52.831308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:52.839233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3544bf12-0e43-4748-a555-6815696656fd tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.170284 Jul 14 11:26:52.839857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 516/987] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:52 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:53.626934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:53.627627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:53.634142 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:53.634593 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:53.635409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:53.635853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:53.772253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:53.781453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a75f9915-3884-40eb-9069-c8d9231d4484 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.158261 Jul 14 11:26:53.782264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 472/988] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:53 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:53.857112 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:53.857732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:53.864710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:53.865145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:53.865936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:53.866358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.009658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:54.017987 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-779fd4e9-415d-4bdf-a0ce-c8674f49b174 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.164973 Jul 14 11:26:54.018574 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 517/989] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:53 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:54.744881 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-ffdf4334-30f6-4c81-992b-fc21e596b4d3 req-8f52a548-ace3-4cb8-b0e5-4a4c7d431de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beae9bb-3e63-453f-9262-7d2b446ea357", "name": "network-vif-plugged", "status": "completed", "tag": "b634c1af-ed40-40e7-a037-e3aa95ce980e"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:26:54.755706 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-ffdf4334-30f6-4c81-992b-fc21e596b4d3 req-8f52a548-ace3-4cb8-b0e5-4a4c7d431de8 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.756416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-ffdf4334-30f6-4c81-992b-fc21e596b4d3 req-8f52a548-ace3-4cb8-b0e5-4a4c7d431de8 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.768261 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-ffdf4334-30f6-4c81-992b-fc21e596b4d3 req-8f52a548-ace3-4cb8-b0e5-4a4c7d431de8 service nova] Creating event network-vif-plugged:b634c1af-ed40-40e7-a037-e3aa95ce980e for instance 1beae9bb-3e63-453f-9262-7d2b446ea357 on hv-cinder-82282 Jul 14 11:26:54.773534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-ffdf4334-30f6-4c81-992b-fc21e596b4d3 req-8f52a548-ace3-4cb8-b0e5-4a4c7d431de8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Jul 14 11:26:54.774255 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 473/990] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:26:54.798736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:54.799277 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:54.805608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.806126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.806831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.807329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.841231 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:54.842260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:54.850146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.850618 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.862403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.862403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.890288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-80aa2f9e-ba0b-4248-9601-17f525ebfdf5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053349 Jul 14 11:26:54.890882 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 474/991] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:26:54 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:26:54.971368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:54.971993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:54.979630 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.981006 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:54.981861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:54.982310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:55.007866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:55.014086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:26:55.017545 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-95918220-f1d1-4c94-99d1-0dbffd0d86da tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.222646 Jul 14 11:26:55.023071 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 518/992] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:54 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:55.039719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:55.039719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:55.043789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:55.044274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:55.045086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:55.045524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:55.191091 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:55.199312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ed77c42a-0f89-427d-9211-a172560ff5f5 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.166904 Jul 14 11:26:55.200184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 519/993] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:55 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:55.373357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-22a21a8f-28cf-4715-81d2-1959f000a8b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 204 len: 0 microversion: 2.1 time: 0.405798 Jul 14 11:26:55.373955 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 475/994] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:26:54 2022] DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:26:55.382647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:55.383286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:55.390720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:55.391194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:55.392025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:55.392452 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:55.535304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:55.543444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3910911a-246e-420b-ba7f-9d8d066e4d24 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1672 microversion: 2.1 time: 0.164530 Jul 14 11:26:55.543914 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 520/995] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:55 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:56.035290 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:56.036282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:56.044164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.044939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.045777 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.046268 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.207068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:56.215266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4b778a9d-fffe-42a8-932d-cb9271c334d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.183635 Jul 14 11:26:56.216026 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 476/996] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:56 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:56.217345 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:56.217830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:56.225840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.225840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.226816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.226816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.370483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:56.378507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a236c819-1adf-4de4-8e5e-2b3c6dc0e54e tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.165682 Jul 14 11:26:56.379093 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 521/997] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:56 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:56.561020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:56.561637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:56.567816 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.568274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.569089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:56.569530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:56.732059 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:56.741739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bed2db4e-26a0-4a0a-9085-16f19ad51b30 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1672 microversion: 2.1 time: 0.184534 Jul 14 11:26:56.742332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 477/998] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:56 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:57.234386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:57.235048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:57.241905 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.242356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.243377 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.243821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.397041 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:57.397805 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:57.405321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.406204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.407037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.407507 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.409198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:57.417995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b0375e71-34cc-4476-8873-ec0407099b0f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.187497 Jul 14 11:26:57.418700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 522/999] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:57 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:57.566710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:57.574809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-42ea2b57-3720-4857-b439-1cc00f418093 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.181482 Jul 14 11:26:57.575489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 478/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:57 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:26:57.764157 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:57.764778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:57.770676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.771143 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.771925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:57.772362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:57.925997 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:57.933844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-20f3bde4-6474-486d-9607-914dbc44e317 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1672 microversion: 2.1 time: 0.173666 Jul 14 11:26:57.934412 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 523/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:57 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:58.435870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:58.436603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:58.443461 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.446558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.446558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.446558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.585410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:58.592082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:58.592738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:58.593755 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-81401f1f-36aa-4cd2-8dcb-c6a4abaa901b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1266 microversion: 2.1 time: 0.162394 Jul 14 11:26:58.594345 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 479/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:58 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:58.599771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.600230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.601008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.601452 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.752655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:58.760687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a565b3a7-6a39-48e3-a33f-92ab79e3c2f3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.173167 Jul 14 11:26:58.773422 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 524/1003] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:58 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:58.952369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:58.955762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:58.955762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:58.959763 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.960218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:58.960991 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:58.961491 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.113562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:59.124504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5c1976ac-4878-4707-a5b9-a686461ccd3e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1672 microversion: 2.1 time: 0.177165 Jul 14 11:26:59.125798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 480/1004] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:58 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:59.611509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:59.612871 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:59.620706 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.622597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.623768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.624405 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.781577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:59.782196 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:59.788521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.793927 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.793927 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.793927 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.848194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:59.858059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-24cef98b-095c-49e4-8e7c-cc999fb7725c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1453 microversion: 2.1 time: 0.251027 Jul 14 11:26:59.868471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 525/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:59 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:26:59.875229 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:26:59.876182 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:26:59.882760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.883429 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.884212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:26:59.884654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:26:59.932844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:26:59.941437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4fae20d9-c24f-49cd-9534-9c43a556fd7d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.164078 Jul 14 11:26:59.942300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 481/1006] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:59 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:00.142158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:00.142867 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:00.149736 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.150267 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:00.151114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.151578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:00.220603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:00.228777 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-23115e2b-d2de-4427-84b0-2c87db7baf3c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1605 microversion: 2.1 time: 0.090584 Jul 14 11:27:00.229547 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 482/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:00 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1605 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:27:00.292847 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:00.301267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c5a292b2-1d1e-48ae-ad72-af998b364897 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1453 microversion: 2.1 time: 0.430348 Jul 14 11:27:00.301854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 526/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:26:59 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1453 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:00.418171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-aa517569-a403-4d13-945b-58781a49b189 req-750a9087-44f4-415a-9e90-2ac41be859db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3c6670-5e21-4f8e-93c1-66a524a5510d", "name": "network-vif-deleted", "tag": "9f0c7c24-b3e4-438d-bf41-131c88721ff4"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:00.427779 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-aa517569-a403-4d13-945b-58781a49b189 req-750a9087-44f4-415a-9e90-2ac41be859db service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.428231 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-aa517569-a403-4d13-945b-58781a49b189 req-750a9087-44f4-415a-9e90-2ac41be859db service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:00.440173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-aa517569-a403-4d13-945b-58781a49b189 req-750a9087-44f4-415a-9e90-2ac41be859db service nova] Creating event network-vif-deleted:9f0c7c24-b3e4-438d-bf41-131c88721ff4 for instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d on hv-cinder-82282 Jul 14 11:27:00.446707 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-aa517569-a403-4d13-945b-58781a49b189 req-750a9087-44f4-415a-9e90-2ac41be859db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Jul 14 11:27:00.451147 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 483/1009] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:00.961959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:00.963732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:00.972073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.972301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:00.973198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:00.973643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:01.160586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:01.169855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-24f4a600-39c9-46f2-a576-056b97c469a3 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.213785 Jul 14 11:27:01.170747 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 527/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:00 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:01.250748 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:01.252572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:01.262609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:01.263862 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:01.265025 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:01.265689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:01.270838 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:01.310076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:01.310549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:01.311000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lazy-loading 'fault' on Instance uuid 0e3c6670-5e21-4f8e-93c1-66a524a5510d {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:27:01.448191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:01.458164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3888b442-d962-4bc2-85cf-3eced1525d10 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 200 len: 1327 microversion: 2.1 time: 0.214280 Jul 14 11:27:01.459034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 484/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:01 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 1327 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:02.191665 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:02.192771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:02.208637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:02.209597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:02.211279 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:02.212077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:02.364852 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:02.370471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e4194bea-e738-4697-bff3-f289df0c28e9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.186004 Jul 14 11:27:02.371837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 528/1012] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:02 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:02.485679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:02.485679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:02.492509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:02.493218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:02.494340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:02.494784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:02.512717 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] HTTP exception thrown: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Request method failure captured: Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d HTTP/1.1 Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_ujfws38EoVjL7TI-V3N9pv9_N1tXaSjkfCJDSuA35Ks4zp0Hv2EfMmNpWj88v5o-ZfHW3ZIGco1EI6pZGRqBo361w4iTAYi3injzatf9Ca4a8clB6sZuAGGNRcGqV4H7CG9jdO6ym8-HqyUwXninJw-HhzRcEzJdrmen3FFw-HL1o Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:27:02.515161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6cf0cfc65d914753b1e19db9e238b4dd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 4ebc96dc6b16411a9adb8e91793cda07 Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:27:02.516554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '0e3c6670-5e21-4f8e-93c1-66a524a5510d'} Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:27:02.517453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:27:02.518796 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:27:02.520621 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Returning 404 to user: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:27:02.521565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-aed3c850-72e1-40fa-9728-32103b5be9dc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 404 len: 111 microversion: 2.1 time: 0.047807 Jul 14 11:27:02.522136 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 485/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:02 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:27:02.535837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-77f36e1a-cd17-44f0-b29a-340b68d8981d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '.version_select at 0x7f34123ea670>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:02.633622 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-77f36e1a-cd17-44f0-b29a-340b68d8981d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823008519" status: 202 len: 0 microversion: 2.1 time: 0.106603 Jul 14 11:27:02.636854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 529/1014] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jul 14 11:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823008519 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:27:03.253743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-95ae3686-40a9-4a91-858b-ecee26de5802 req-c732bc34-602b-4d1a-b83f-f8ec07ccff24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1beae9bb-3e63-453f-9262-7d2b446ea357", "tag": "b634c1af-ed40-40e7-a037-e3aa95ce980e"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:03.265727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-95ae3686-40a9-4a91-858b-ecee26de5802 req-c732bc34-602b-4d1a-b83f-f8ec07ccff24 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:03.266454 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-95ae3686-40a9-4a91-858b-ecee26de5802 req-c732bc34-602b-4d1a-b83f-f8ec07ccff24 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:03.293878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-95ae3686-40a9-4a91-858b-ecee26de5802 req-c732bc34-602b-4d1a-b83f-f8ec07ccff24 service nova] Creating event network-changed:b634c1af-ed40-40e7-a037-e3aa95ce980e for instance 1beae9bb-3e63-453f-9262-7d2b446ea357 on hv-cinder-82282 Jul 14 11:27:03.299693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-95ae3686-40a9-4a91-858b-ecee26de5802 req-c732bc34-602b-4d1a-b83f-f8ec07ccff24 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051600 Jul 14 11:27:03.300926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 486/1015] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:03.394977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:03.397716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:03.411242 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:03.416818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:03.416818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:03.416818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:03.500230 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-21c4c306-7b85-4d71-ae73-6ad768d4bf0e req-8aed553a-7bad-496d-9418-d8d0b44076fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "name": "network-vif-plugged", "status": "completed", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:03.517983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-21c4c306-7b85-4d71-ae73-6ad768d4bf0e req-8aed553a-7bad-496d-9418-d8d0b44076fb service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:03.519950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-21c4c306-7b85-4d71-ae73-6ad768d4bf0e req-8aed553a-7bad-496d-9418-d8d0b44076fb service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:03.537769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-21c4c306-7b85-4d71-ae73-6ad768d4bf0e req-8aed553a-7bad-496d-9418-d8d0b44076fb service nova] Creating event network-vif-plugged:0cba2204-9945-44b4-b7d6-bf19dc81c7cc for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c on hv-cinder-82282 Jul 14 11:27:03.546693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-21c4c306-7b85-4d71-ae73-6ad768d4bf0e req-8aed553a-7bad-496d-9418-d8d0b44076fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052734 Jul 14 11:27:03.548135 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 487/1016] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:03.667840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:03.677436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b3a3118c-6ab5-46af-89ac-ec4e2c8f9012 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.292325 Jul 14 11:27:03.688041 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 530/1017] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:03 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:03.760847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b8940e25-bcda-4e80-ac92-fbca6f3f6d72 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: .version_select at 0x7f3412b07d30>, body: {"keypair": {"name": "tempest-keypair-854508281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRuEtQTUgfcNtKp+TprQjN1tStw1bqWnvEiXicQRNgHMy/fbngkqMYGDuiWlY0T8VBalF4Loc2g00bwLVww4Sosk6qmdw6kCQJgfBc/mVAqRCOk/uhwQcq5RId2N8LMeA=="}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:03.797890 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-b8940e25-bcda-4e80-ac92-fbca6f3f6d72 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'key_pairs'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:27:03.812568 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-b8940e25-bcda-4e80-ac92-fbca6f3f6d72 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for user 4ebc96dc6b16411a9adb8e91793cda07 and project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'key_pairs'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:27:03.913202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b8940e25-bcda-4e80-ac92-fbca6f3f6d72 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161609 Jul 14 11:27:03.914491 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 488/1018] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:27:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:04.695425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:04.696038 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:04.703583 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:04.704040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:04.704863 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:04.705259 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:04.708107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=100 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:04.901967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:04.915991 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a84dafc6-221c-4061-bcd6-ba1e8bed2071 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.223992 Jul 14 11:27:04.920840 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 531/1019] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:04 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:05.942651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:05.944326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:05.956157 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:05.956629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:05.960654 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:05.960654 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:06.131592 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:06.142694 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2c0b945d-81bd-476d-939c-48d96dbeeef4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1573 microversion: 2.1 time: 0.207306 Jul 14 11:27:06.157546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 489/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:05 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:06.760458 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-104964023", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33f5e5d7-403b-4ede-91af-86c50ab05f2c"}], "security_groups": [{"name": "tempest-securitygroup--1068001262"}], "key_name": "tempest-keypair-854508281", "user_data": "}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:06.890727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] validate_networks() for [('33f5e5d7-403b-4ede-91af-86c50ab05f2c', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:27:07.168089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:07.169538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:07.200590 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:07.201079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:07.201932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:07.202438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:07.299417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:27:07.299843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:27:07.300319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:27:07.300732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:27:07.301150 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:27:07.312426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:07.312893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:07.313850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:07.314363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:07.336573 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:27:07.342190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Getting quotas for user 4ebc96dc6b16411a9adb8e91793cda07 and project 6cf0cfc65d914753b1e19db9e238b4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:27:07.356169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:27:07.359234 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:27:07.384233 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:07.393299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-add178c5-8f96-4478-b239-0425e28b57c4 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1560 microversion: 2.1 time: 0.229371 Jul 14 11:27:07.393902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 490/1021] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:07 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:07.497394 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-08e974ca-61a1-4768-96f2-c7fe7a0e3099 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.741160 Jul 14 11:27:07.498040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 532/1022] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:27:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:27:07.508071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-214661c0-a6cf-4645-843e-62d87a11c768 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:07.508823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-214661c0-a6cf-4645-843e-62d87a11c768 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:07.575177 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-214661c0-a6cf-4645-843e-62d87a11c768 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:07.582368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-214661c0-a6cf-4645-843e-62d87a11c768 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1236 microversion: 2.1 time: 0.078265 Jul 14 11:27:07.583143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 491/1023] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:07 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:08.601509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:08.602128 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:08.610442 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:08.610909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:08.611767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:08.612174 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:08.696856 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:08.706216 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bed106fa-7f5b-44d5-8b0b-3a7bb1ac7b1a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1240 microversion: 2.1 time: 0.109116 Jul 14 11:27:08.706887 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 533/1024] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:08 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:09.723556 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:09.724232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:09.732158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:09.732613 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:09.733395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:09.733836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:09.812787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:09.820917 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cfe70e08-042d-47f8-ba57-8afc5d6198fc tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1232 microversion: 2.1 time: 0.101299 Jul 14 11:27:09.821503 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 492/1025] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:09 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1232 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:10.838641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:10.839529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:10.847112 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:10.847615 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:10.848362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:10.848795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:10.935681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:10.945143 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a1619d0f-0597-4266-8c2d-929d9b18a2e2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1296 microversion: 2.1 time: 0.110143 Jul 14 11:27:10.946184 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 534/1026] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:10 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:11.971619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:11.972516 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:11.982108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:11.983060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:11.984643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:11.985349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:12.262062 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:12.275946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7ee175c9-0d63-4c22-938a-84372e676e99 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.309650 Jul 14 11:27:12.277054 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 493/1027] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:11 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:13.286451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-e2fbd7ed-4733-4ffa-8f18-0474421d94fd req-58b84308-05fe-4e17-8cb3-04913b21be6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f0d168-ea3e-4b54-88cd-1607d647f68a", "tag": "16bfd6f1-89ae-480c-b717-d4875d429874"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:13.302086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:13.302799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:13.312644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:13.318294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:13.318294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:13.318294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:13.320338 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e2fbd7ed-4733-4ffa-8f18-0474421d94fd req-58b84308-05fe-4e17-8cb3-04913b21be6f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:13.320863 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e2fbd7ed-4733-4ffa-8f18-0474421d94fd req-58b84308-05fe-4e17-8cb3-04913b21be6f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:13.340259 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-e2fbd7ed-4733-4ffa-8f18-0474421d94fd req-58b84308-05fe-4e17-8cb3-04913b21be6f service nova] Creating event network-changed:16bfd6f1-89ae-480c-b717-d4875d429874 for instance 55f0d168-ea3e-4b54-88cd-1607d647f68a on hv-cinder-82282 Jul 14 11:27:13.345681 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-e2fbd7ed-4733-4ffa-8f18-0474421d94fd req-58b84308-05fe-4e17-8cb3-04913b21be6f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072740 Jul 14 11:27:13.346831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 535/1028] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:13.609401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:13.618275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-441631bb-821c-43b6-986f-0f9ee91d4c48 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.320200 Jul 14 11:27:13.618966 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 494/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:13 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:14.647707 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:14.648944 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:14.656473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:14.657824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:14.657824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:14.658208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:14.804692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:14.812968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1a3cff12-5d91-458e-80d5-588bd7850c27 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.173198 Jul 14 11:27:14.813542 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 536/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:14 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:15.833057 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:15.834195 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:15.841445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:15.841909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:15.842704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:15.843170 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:16.008391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:16.017912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-76ae23ef-7d88-49fc-8b81-c58b76e0252f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.190812 Jul 14 11:27:16.018681 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 495/1031] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:15 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:17.037763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:17.038779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:17.049373 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:17.050218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:17.051473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:17.052169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:17.221092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:17.228798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e9b9e9b2-5c10-4267-b0e2-9aaa6f5d0c56 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.196584 Jul 14 11:27:17.231297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 537/1032] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:17 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:18.246943 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:18.247584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:18.250015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:18.255102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:18.255578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:18.256353 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:18.256787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:18.417756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:18.426141 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1590fd6d-5b9c-4c19-aa68-ad6cd9221e8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.184027 Jul 14 11:27:18.429060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 496/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:18 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:19.447159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:19.447697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:19.449697 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:19.450364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=6 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:19.456122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:19.456607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:19.457489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:19.457972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:19.621096 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:19.629794 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-cbeb60b6-15cc-4285-a165-220f85f42bdb tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.188259 Jul 14 11:27:19.630391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 538/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:19 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:20.650438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:20.651075 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:20.658919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:20.659406 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:20.660211 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:20.660656 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:20.817611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:20.826004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b51c9754-4966-4b1f-87c0-1d30e8fc3a44 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.179423 Jul 14 11:27:20.826558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 497/1035] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:20 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:21.845189 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:21.846249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:21.859757 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:21.860359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:21.861655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:21.862320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:22.024154 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:22.036715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c9365544-a5ad-4387-82e0-0146c1e7c9d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.194016 Jul 14 11:27:22.036715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 539/1036] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:21 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:27:23.055655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:23.063920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:23.064695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:23.065091 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:23.065870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:23.066388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:23.231572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:23.239513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-52cef4e6-4817-405b-ba04-7c8f8bdc17b7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.189723 Jul 14 11:27:23.240159 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 498/1037] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:23 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:27:24.261356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:24.262363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:24.265714 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:24.270821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:24.271311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:24.272156 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:24.272595 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:24.429376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:24.438574 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9d9fa7f3-9b9f-45cd-82d4-790e31c66f74 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.183096 Jul 14 11:27:24.439421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 540/1038] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:24 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:24.724262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:24.724877 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:24.731659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:24.732185 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:24.733133 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:24.733697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:24.759179 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a6c71e7b-945c-444c-91c6-66c827c9f9f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/ips" status: 200 len: 153 microversion: 2.20 time: 0.263940 Jul 14 11:27:24.759749 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 499/1039] 10.222.0.59 () {60 vars in 1288 bytes} [Thu Jul 14 11:27:24 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/ips => generated 153 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:27:25.459097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:25.459963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:25.467803 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:25.468255 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:25.469167 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:25.469612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:25.630743 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:25.639786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8da828bb-cc32-478d-8514-ea8f414757b2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.184555 Jul 14 11:27:25.640357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 541/1040] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:25 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:27:26.572619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-26abc26c-3467-450a-8331-0494cec5dc4c req-327a3f23-235a-4fd5-916a-c461f79768cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f0d168-ea3e-4b54-88cd-1607d647f68a", "name": "network-vif-plugged", "status": "completed", "tag": "16bfd6f1-89ae-480c-b717-d4875d429874"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:26.581875 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-26abc26c-3467-450a-8331-0494cec5dc4c req-327a3f23-235a-4fd5-916a-c461f79768cd service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:26.582239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-26abc26c-3467-450a-8331-0494cec5dc4c req-327a3f23-235a-4fd5-916a-c461f79768cd service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:26.596373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-26abc26c-3467-450a-8331-0494cec5dc4c req-327a3f23-235a-4fd5-916a-c461f79768cd service nova] Creating event network-vif-plugged:16bfd6f1-89ae-480c-b717-d4875d429874 for instance 55f0d168-ea3e-4b54-88cd-1607d647f68a on hv-cinder-82282 Jul 14 11:27:26.601491 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-26abc26c-3467-450a-8331-0494cec5dc4c req-327a3f23-235a-4fd5-916a-c461f79768cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032655 Jul 14 11:27:26.602092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 500/1041] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:26.658091 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:26.658810 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:26.667977 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:26.668689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:26.669651 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:26.670081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:26.828474 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:26.842089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fa22fa59-8122-4e42-85a1-addcd7e5897f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.184638 Jul 14 11:27:26.842089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 542/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:26 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:27.859216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:27.860140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:27.866980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:27.867460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:27.868240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:27.868674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:28.038049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:28.049529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4eb76d61-3dde-4458-982a-2ad0360d7218 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.196025 Jul 14 11:27:28.050588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 501/1043] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:27 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:29.071139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:29.071749 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:29.080482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.080943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.081752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.082195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.118850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:29.119800 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:29.123936 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:29.134511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.141095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.141095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.141095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.171334 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lazy-loading 'flavor' on Instance uuid 435b5cca-1893-4891-9f5c-45cf76ac4f67 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:27:29.293927 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:29.302855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9c68ebd1-fc13-4dc6-bf64-a0615565c14f tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1362 microversion: 2.1 time: 0.237247 Jul 14 11:27:29.309660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 543/1044] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:29 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:29.813806 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9baa678f-0003-4422-b544-4f00ebe30ea4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/action" status: 202 len: 0 microversion: 2.20 time: 0.700982 Jul 14 11:27:29.814456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 502/1045] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jul 14 11:27:29 2022] POST /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:27:29.823678 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:29.824719 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:29.832473 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.832907 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.833703 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:29.834130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:29.973101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:29.982738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:29.984344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:29.985555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-959e5c0a-c593-4df4-b8b9-6817d9d2e6da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.166328 Jul 14 11:27:29.986115 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 544/1046] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:29 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:30.324101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:30.324727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:30.331227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.331678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.332453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.332891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.351734 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:30.476691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:30.485620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2371c036-544f-462f-95de-e05e06370a8e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1548 microversion: 2.1 time: 0.166383 Jul 14 11:27:30.486199 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 503/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:27:30 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:27:30.505683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:30.506379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:30.516215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.516687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.517644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:30.518126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:30.597098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-351445f8-1016-4ce8-93c3-a3346718e0c7 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097064 Jul 14 11:27:30.597692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 545/1048] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:27:30 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:31.005321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:31.006102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:31.013738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:31.014303 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:31.015197 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:31.015716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:31.177399 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:31.194607 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:31.197603 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:31.200629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-88274167-69f5-42e2-bee9-bd52e5e29985 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.199363 Jul 14 11:27:31.201673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 504/1049] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:30 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:31.949635 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-8126ef60-2fb8-499d-be8a-8ee2e040fcaf req-3ea99eb2-b9d8-4fc7-b16b-6957dc8f0aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55f0d168-ea3e-4b54-88cd-1607d647f68a", "tag": "16bfd6f1-89ae-480c-b717-d4875d429874"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:31.958103 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-8126ef60-2fb8-499d-be8a-8ee2e040fcaf req-3ea99eb2-b9d8-4fc7-b16b-6957dc8f0aef service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:31.958556 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-8126ef60-2fb8-499d-be8a-8ee2e040fcaf req-3ea99eb2-b9d8-4fc7-b16b-6957dc8f0aef service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:31.971063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-8126ef60-2fb8-499d-be8a-8ee2e040fcaf req-3ea99eb2-b9d8-4fc7-b16b-6957dc8f0aef service nova] Creating event network-changed:16bfd6f1-89ae-480c-b717-d4875d429874 for instance 55f0d168-ea3e-4b54-88cd-1607d647f68a on hv-cinder-82282 Jul 14 11:27:31.977358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-8126ef60-2fb8-499d-be8a-8ee2e040fcaf req-3ea99eb2-b9d8-4fc7-b16b-6957dc8f0aef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031509 Jul 14 11:27:31.978550 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 546/1050] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:32.230171 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:32.231012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:32.238093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:32.238637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:32.239474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:32.239919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:32.391372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:32.399934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:32.402191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:32.403679 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d9302c5e-19b6-4b94-bdff-861f301e80e5 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.177965 Jul 14 11:27:32.404500 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 505/1051] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:32 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:27:33.424045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:33.424854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:33.431318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:33.431892 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:33.433232 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:33.433716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:33.591447 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:33.600693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:33.602199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:33.603449 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ca30448e-c907-4a62-ad12-516aafbbdfaf tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.184528 Jul 14 11:27:33.604017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 547/1052] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:33 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:34.624210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:34.624851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:34.631405 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:34.636011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:34.636011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:34.636011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:34.781602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:34.790955 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:34.793031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:34.794498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1b34540e-2bfa-4ee2-8f70-d6e1d2dc76b3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.175890 Jul 14 11:27:34.795360 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 506/1053] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:34 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:35.814034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:35.814830 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:35.824096 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:35.824875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:35.826149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:35.826908 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:35.834357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=88 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:36.014239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:36.022913 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:36.024478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:36.025642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c65cb5ab-227d-458a-9334-e2383fee9877 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.216118 Jul 14 11:27:36.026691 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 548/1054] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:35 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:37.045924 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:37.046738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:37.054173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:37.056247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:37.056247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:37.056247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:37.205089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:37.213484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:37.215501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:37.216718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-28252c4c-5266-425b-9294-28284054eef1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.175304 Jul 14 11:27:37.217301 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 507/1055] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:37 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:38.236433 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:38.237100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:38.249343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:38.251330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:38.251330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:38.251330 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:38.402534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:38.410637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:38.412165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:38.413327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a033d6a6-10e5-439f-8fe5-dd0d37e32673 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.180798 Jul 14 11:27:38.413874 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 549/1056] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:38 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:39.432114 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:39.433503 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:39.440447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:39.440900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:39.441684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:39.444536 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:39.597929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:39.607941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:39.609466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:39.610662 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-54031d30-eb4d-4862-863d-7602ac798bc8 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.182511 Jul 14 11:27:39.611253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 508/1057] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:39 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:27:40.631687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:40.632461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:40.641854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:40.642302 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:40.643085 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:40.643608 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:40.785137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:40.793934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:40.795657 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:40.796864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a4c8c144-57bd-40be-9452-eab22f4519f9 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.170864 Jul 14 11:27:40.797446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 550/1058] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:40 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:41.818278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:41.818898 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:41.826478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:41.826914 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:41.827739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:41.828182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:41.975096 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:41.985945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:41.987495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:41.988704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-90c31da9-99f1-48c8-9b51-b219ed7c28b6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.175666 Jul 14 11:27:41.989235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 509/1059] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:41 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:43.008376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:43.008993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:43.016168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:43.016590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:43.018767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:43.018767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:43.160087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:43.169357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:43.171003 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:43.172375 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5efdd8c6-ce76-4b2b-b192-f9787ea7ea88 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.168125 Jul 14 11:27:43.172988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 551/1060] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:43 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:44.190487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:44.191106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:44.198044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:44.198494 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:44.199309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:44.200428 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:44.341809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:44.350178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:44.351723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:44.352894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-56f5ac34-1cad-4701-b01d-fefd9e699e50 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.166375 Jul 14 11:27:44.353452 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 510/1061] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:44 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:45.372444 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:45.373007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:45.379680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:45.380134 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:45.380924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:45.381365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:45.524821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:45.538575 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:45.540124 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:45.541324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b7927a8d-de04-4333-ab3f-2aae72cd2b51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.173815 Jul 14 11:27:45.541883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 552/1062] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:45 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:46.560689 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:46.561328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:46.567989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:46.568433 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:46.569248 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:46.569686 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:46.714690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:46.724935 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:46.726471 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:46.727681 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-17f75adf-1e6f-4018-8b6f-6ff1af218c1d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.171734 Jul 14 11:27:46.728235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 511/1063] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:46 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:47.748805 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:47.750213 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:47.759039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:47.772671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:47.772671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:47.772671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:47.908247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:47.916537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:47.918119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:47.919335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bc3f2ab8-92d5-43cd-9678-175f1fff989f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.175791 Jul 14 11:27:47.919892 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 553/1064] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:47 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:48.938655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:48.939329 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:48.946108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:48.946564 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:48.947383 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:48.947823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:49.090276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:49.098666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:49.100206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:49.101377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a76c297b-dca4-4cee-9bf3-27e6019d0777 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.167498 Jul 14 11:27:49.101934 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 512/1065] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:48 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:50.120653 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:50.122094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:50.129306 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:50.129752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:50.130631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:50.131066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:50.268553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:50.276854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:50.278413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:50.279668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-aeba1b1d-a9a8-4609-bdfe-8e561c8f7594 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.163038 Jul 14 11:27:50.280245 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 554/1066] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:50 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:51.299095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:51.299738 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:51.306512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:51.306961 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:51.337869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:51.337869 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:51.447763 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:51.457350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:51.458878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:51.460089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9b15e9fe-a886-4590-8804-6f39c89cc032 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1746 microversion: 2.20 time: 0.164987 Jul 14 11:27:51.460684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 513/1067] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:51 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:52.479756 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:52.480409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:52.488413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:52.488864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:52.489644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:52.490082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:52.634159 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:52.642588 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:52.644134 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:52.645324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-974fc0e6-7fc2-431c-914b-6d7d988c1882 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1746 microversion: 2.20 time: 0.169654 Jul 14 11:27:52.645888 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 555/1068] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:52 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:53.665334 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:53.665936 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:53.674153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:53.674611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:53.675542 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:53.675995 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:53.826682 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:53.835015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:53.836942 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:53.838167 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6f5c8df8-f48b-450a-9e80-d745903c3847 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1746 microversion: 2.20 time: 0.177420 Jul 14 11:27:53.838724 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 514/1069] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:53 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:54.858076 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:54.858711 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:54.861053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=32 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:54.866329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:54.866779 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:54.867594 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:54.868035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:55.011535 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:55.021635 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:55.023359 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:55.024696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c157abab-ceca-4a1c-810d-fdaa3c824ef3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1746 microversion: 2.20 time: 0.171088 Jul 14 11:27:55.025311 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 556/1070] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:54 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:55.226589 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-0c8473dd-e03c-4eef-a71f-aa1e2de07469 req-ee13a1af-c91d-4ef0-958b-91b7ca5e3640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "name": "network-vif-plugged", "status": "completed", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:27:55.235909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-0c8473dd-e03c-4eef-a71f-aa1e2de07469 req-ee13a1af-c91d-4ef0-958b-91b7ca5e3640 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:55.236362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-0c8473dd-e03c-4eef-a71f-aa1e2de07469 req-ee13a1af-c91d-4ef0-958b-91b7ca5e3640 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:55.248859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-0c8473dd-e03c-4eef-a71f-aa1e2de07469 req-ee13a1af-c91d-4ef0-958b-91b7ca5e3640 service nova] Creating event network-vif-plugged:929d3c0f-d941-4817-9998-3cb5f75695d3 for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 on hv-cinder-82282 Jul 14 11:27:55.253987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-0c8473dd-e03c-4eef-a71f-aa1e2de07469 req-ee13a1af-c91d-4ef0-958b-91b7ca5e3640 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031092 Jul 14 11:27:55.254651 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 515/1071] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:27:56.046724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:56.047347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:56.054059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:56.054506 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:56.055321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:56.055764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:56.191468 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:56.199554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:56.201260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:56.202468 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e9a8a181-6fcd-473e-8d85-58445d2d929b tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1746 microversion: 2.20 time: 0.160782 Jul 14 11:27:56.203021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 557/1072] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:56 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:57.223072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:57.223831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:57.230502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:57.230959 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:57.231789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:57.232304 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:57.369720 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:57.378778 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:57.380430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:57.381661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-497f607b-82e7-4784-9fe9-34033f54f698 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1746 microversion: 2.20 time: 0.163387 Jul 14 11:27:57.382253 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 516/1073] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:57 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:58.401013 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:58.401695 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:58.409270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:58.409757 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:58.410540 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:58.410980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:58.554772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:58.563193 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:58.564785 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:58.565969 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5cb6a603-4039-4822-afbb-898248cb029d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.169235 Jul 14 11:27:58.566532 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 558/1074] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:58 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:27:59.586226 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:27:59.586969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:27:59.589691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=30 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:59.596693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:59.597183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:59.598191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:27:59.598636 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:27:59.760757 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:59.772174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:59.773685 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:27:59.774902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-205bb050-ffa3-4997-9f72-6b106c62505e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.193049 Jul 14 11:27:59.779644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 517/1075] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:27:59 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:00.797308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:00.798276 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:00.808288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:00.809402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:00.811472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:00.812153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:00.958094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:00.967686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:00.969241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:00.970579 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ca4cc005-b6e7-4f77-b8e9-76b7718a3b56 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.178354 Jul 14 11:28:00.971398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 559/1076] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:00 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:01.990518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:01.991429 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:01.999174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:01.999480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:02.000069 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:02.000508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:02.003535 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=83 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:02.153049 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:02.163997 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:02.165585 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:02.166764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-50676c82-ce75-4b25-b77a-4e5db6ed861a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.180487 Jul 14 11:28:02.167666 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 518/1077] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:01 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:03.186417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:03.187089 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:03.194353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:03.194804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:03.195596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:03.196035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:03.346464 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:03.355613 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:03.357296 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:03.359018 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6949fcb9-72dc-416b-a827-fff186c042fc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.177557 Jul 14 11:28:03.360004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 560/1078] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:03 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:04.378563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:04.379240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:04.400506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:04.401236 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:04.402471 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:04.403193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:04.628894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:04.641257 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:04.646884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:04.646884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f634e524-74b2-45a1-9afc-23686d449d72 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.269395 Jul 14 11:28:04.646884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 519/1079] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:04 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:05.665278 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:05.665880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:05.674965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:05.675767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:05.676945 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:05.677583 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:05.881051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:05.898369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:05.900094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:05.901351 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5ad92d78-29b3-4791-889c-16667ab9d212 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.242759 Jul 14 11:28:05.901995 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 561/1080] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:05 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:28:06.924015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:06.924624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:06.930815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:06.931381 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:06.932158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:06.932589 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:07.079575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:07.091298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:07.094089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:07.095958 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-af2fd070-aae4-49e2-b93e-f736c3be811f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.176436 Jul 14 11:28:07.099211 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 520/1081] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:06 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:08.123673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:08.124751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:08.137253 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:08.137899 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:08.139270 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:08.140080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:08.149347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=84 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:08.323014 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:08.343169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:08.346894 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:08.348365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8bd3e05e-de75-48f7-92b1-2cd4e5fb4b31 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.231042 Jul 14 11:28:08.349065 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 562/1082] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:08 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:09.373832 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:09.374681 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:09.381942 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:09.389901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:09.389901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:09.389901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:09.587526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:09.598427 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:09.601735 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:09.603759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1f09bb5a-1a54-4ce9-a7ec-ad12cb9e30f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.233865 Jul 14 11:28:09.604752 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 521/1083] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:09 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:10.628953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:10.629614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:10.635831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:10.636282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:10.637050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:10.637489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:10.780148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:10.788849 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:10.799780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:10.799780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6ff36f2d-f94a-4005-8826-96bf4993484e tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.167365 Jul 14 11:28:10.799780 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 563/1084] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:10 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:11.821579 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:11.824317 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:11.837131 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:11.838434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:11.840204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:11.842027 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:12.033221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:12.041700 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:12.043235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:12.044956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-148d94d6-d6bf-4ec4-a57b-87468562c85a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.236424 Jul 14 11:28:12.056478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 522/1085] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:11 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:13.064595 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:13.065545 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:13.072205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:13.072649 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:13.073417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:13.073855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:13.214049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:13.222257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:13.223848 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:13.225026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a376b3f9-8f27-4f85-9b00-11276998904a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1741 microversion: 2.20 time: 0.165188 Jul 14 11:28:13.225589 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 564/1086] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:13 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:14.248119 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:14.249923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:14.262550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:14.263155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:14.264895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:14.266831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:14.434307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:14.443761 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:14.445258 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:14.446434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ceace7e6-0cf8-4280-bd09-418ae1166484 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1723 microversion: 2.20 time: 0.205816 Jul 14 11:28:14.446987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 523/1087] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:14 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:15.466173 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:15.467973 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:15.474301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:15.474746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:15.475546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:15.475978 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:15.625177 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:15.633970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:15.635525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:15.636698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-846a23bd-9b0f-4b10-9c8b-32dc12ae3c07 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1723 microversion: 2.20 time: 0.174662 Jul 14 11:28:15.637261 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 565/1088] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:15 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:16.657283 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:16.658960 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:16.665947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:16.666962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:16.667789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:16.668522 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:16.816599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:16.825349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:16.827912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:16.829216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-109a2248-8302-456c-8d91-592b18cff691 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1726 microversion: 2.20 time: 0.176972 Jul 14 11:28:16.829786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 524/1089] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:16 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:16.851070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4e9eaf1-c9f6-40b7-98cd-e2ce802f5a65"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:16.852418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:16.860179 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:16.860630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:16.861528 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:16.862165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:17.513445 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-a93b0cff-5a07-45eb-bd5e-449dd4498bab req-bd8bebc7-72b1-46ef-9c8c-1aa6a6e65c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "name": "network-vif-unplugged", "status": "completed", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:17.528695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-a93b0cff-5a07-45eb-bd5e-449dd4498bab req-bd8bebc7-72b1-46ef-9c8c-1aa6a6e65c3f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:17.530120 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-a93b0cff-5a07-45eb-bd5e-449dd4498bab req-bd8bebc7-72b1-46ef-9c8c-1aa6a6e65c3f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:17.551261 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.compute.server_external_events [req-a93b0cff-5a07-45eb-bd5e-449dd4498bab req-bd8bebc7-72b1-46ef-9c8c-1aa6a6e65c3f service nova] Unable to find a host for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67. Dropping event network-vif-unplugged {{(pid=118244) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 11:28:17.558430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-a93b0cff-5a07-45eb-bd5e-449dd4498bab req-bd8bebc7-72b1-46ef-9c8c-1aa6a6e65c3f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.186739 Jul 14 11:28:17.558430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 525/1090] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 189 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 11:28:18.241972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b1f62505-42f2-4570-bf0f-bc4e1f72da4f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.396550 Jul 14 11:28:18.242776 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 566/1091] 10.222.0.59 () {62 vars in 1363 bytes} [Thu Jul 14 11:28:16 2022] POST /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-volume_attachments => generated 188 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 11:28:18.363909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:18.364460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:18.371354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:18.371802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:18.372588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:18.373027 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:19.086093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fe15bf79-c288-43fc-8500-4808684839f2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-volume_attachments/a4e9eaf1-c9f6-40b7-98cd-e2ce802f5a65" status: 202 len: 0 microversion: 2.20 time: 0.726454 Jul 14 11:28:19.086728 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 526/1092] 10.222.0.59 () {60 vars in 1456 bytes} [Thu Jul 14 11:28:18 2022] DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-volume_attachments/a4e9eaf1-c9f6-40b7-98cd-e2ce802f5a65 => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:28:19.148086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:19.148647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:19.156470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:19.156908 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:19.157670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:19.158100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:19.450776 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ee883671-e621-469f-adc0-6b6d54004e51 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "POST /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/action" status: 202 len: 0 microversion: 2.20 time: 0.306290 Jul 14 11:28:19.452445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 567/1093] 10.222.0.59 () {62 vars in 1318 bytes} [Thu Jul 14 11:28:19 2022] POST /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:28:19.461404 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:19.462678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:19.470634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:19.471318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:19.472517 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:19.473153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:19.614803 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:19.627044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:19.627044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:19.627044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2392b55e-2218-4ac6-b175-f465d775c910 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1674 microversion: 2.20 time: 0.169904 Jul 14 11:28:19.627490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 527/1094] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:19 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:28:20.647693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:20.648413 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:20.655466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:20.655979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:20.656760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:20.657190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:20.792901 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:20.801215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:20.802733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:20.803915 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-beb423d3-95b3-4c3a-980d-0c54e05bdb27 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1674 microversion: 2.20 time: 0.161854 Jul 14 11:28:20.804472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 568/1095] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:20 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:21.821928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:21.822641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:21.830488 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:21.830939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:21.831758 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:21.832220 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:22.052620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:22.061370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:22.063276 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:22.064486 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0b5c8e5e-2ec9-4710-9bb9-d68ce50f0052 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.246496 Jul 14 11:28:22.065061 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 528/1096] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:21 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:23.084726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:23.086327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:23.095221 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:23.095793 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:23.096687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:23.097285 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:23.272162 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:23.282379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:23.284584 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:23.286399 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0c3f7546-37cf-4f24-a0c5-49362fa7970f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.206667 Jul 14 11:28:23.287493 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 569/1097] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:23 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:24.314646 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:24.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:24.322116 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:24.322574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:24.323402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:24.323846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:24.497771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:24.506662 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:24.508271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:24.509458 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-dcdaf3b5-fbec-43f9-b9b7-426857269049 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.199058 Jul 14 11:28:24.510028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 529/1098] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:24 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:25.528240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:25.528849 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:25.536307 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:25.536765 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:25.537536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:25.537968 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:25.678510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:25.686769 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:25.688342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:25.690045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-73aaab45-c957-4650-9d90-70ab9fdafba0 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.165209 Jul 14 11:28:25.690623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 570/1099] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:25 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:26.711247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:26.711920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:26.719178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:26.719660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:26.720462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:26.720924 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:26.868154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:26.877067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:26.878620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:26.879824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8eff4340-9856-475a-9341-b5d0dda25d54 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.172652 Jul 14 11:28:26.880385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 530/1100] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:26 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:27.899462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:27.900416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:27.907617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=32 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:27.912426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:27.914218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:27.914218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:27.914218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:28.057502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:28.065664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:28.067201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:28.068447 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-06317202-d4c7-4899-a8c8-f06a760b73df tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.173515 Jul 14 11:28:28.069008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 571/1101] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:27 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:29.087232 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:29.087840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:29.094770 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:29.095726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:29.096525 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:29.096963 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:29.512747 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:29.523092 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:29.525812 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:29.527372 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-87f60fe6-ed69-46e0-90e8-63e549fa5f14 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.444032 Jul 14 11:28:29.528506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 531/1102] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:29 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:30.548126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:30.549494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:30.558011 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:30.559027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:30.561512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:30.561512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:30.714671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:30.723403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:30.724928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:30.726116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-eb7f2fab-7d0e-49e4-a2de-a408010f1c8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.183476 Jul 14 11:28:30.726677 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 572/1103] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:30 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:31.745809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:31.746703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:31.750147 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=30 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:31.761112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:31.762070 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:31.762853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:31.763485 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:31.908369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:31.914146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:31.921369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:31.923596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:31.928043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c3a6bb44-55be-4aad-bcb7-c912ee0deb5a tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.182981 Jul 14 11:28:31.928043 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 532/1104] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:31 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:32.946145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:32.946145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:32.952833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:32.953290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:32.954220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:32.955195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:33.101620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:33.110346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:33.112829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:33.114004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2a41d4e3-41b6-44bc-aa17-066fab3484ad tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.173435 Jul 14 11:28:33.114601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 573/1105] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:32 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:28:34.134127 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:34.134739 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:34.142327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:34.142771 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:34.143574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:34.144011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:34.282646 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:34.290608 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:34.292175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:34.293330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7a6e8065-72db-4b02-a5a7-c8262350837d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.163491 Jul 14 11:28:34.293891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 533/1106] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:34 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:35.312617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:35.313217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:35.319827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:35.320269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:35.321033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:35.321461 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:35.455058 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:35.462936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:35.464478 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:35.465645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-35cb84ff-519a-4618-b6ca-7ba6546832da tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.157617 Jul 14 11:28:35.466194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 574/1107] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:35 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:36.485212 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:36.485828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:36.492669 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:36.493117 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:36.493889 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:36.494318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:36.626837 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:36.635183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:36.636691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:36.637846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ad64884a-97c5-4150-b919-e2100821259d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.157605 Jul 14 11:28:36.638406 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 534/1108] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:36 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:37.656917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:37.657509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:37.664129 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:37.664582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:37.665370 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:37.665800 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:37.668495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:37.812358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:37.820759 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:37.822288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:37.823638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a2032376-9ac3-495a-b9be-f976ec28fb8d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.170704 Jul 14 11:28:37.824196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 575/1109] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:37 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:38.843057 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:38.843818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:38.851305 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:38.851761 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:38.852554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:38.852989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:38.991808 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:39.000206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:39.001712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:39.002876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5e4ae6d8-1435-4418-b288-2d075105cde2 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.163866 Jul 14 11:28:39.003466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 535/1110] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:38 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:40.021616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:40.022267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:40.028957 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:40.029406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:40.030185 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:40.030620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:40.175520 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:40.184348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:40.185900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:40.187086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-795f9c55-1db6-4d0f-af74-01f0a39b70ba tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.169649 Jul 14 11:28:40.188421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 576/1111] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:40 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:28:41.206028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:41.207496 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:41.214090 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:41.214545 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:41.215367 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:41.215814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:41.350067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:41.357897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:41.359424 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:41.360615 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8b0ec70b-ca42-4f39-afb5-86d295c2230f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.158602 Jul 14 11:28:41.361164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 536/1112] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:41 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:41.539448 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-e8470794-6615-420f-9651-2d17ad5aa89b req-fdc943eb-e1bb-43c9-871a-1997aaa3ec7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "name": "network-vif-plugged", "status": "completed", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:41.548544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e8470794-6615-420f-9651-2d17ad5aa89b req-fdc943eb-e1bb-43c9-871a-1997aaa3ec7b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:41.552243 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e8470794-6615-420f-9651-2d17ad5aa89b req-fdc943eb-e1bb-43c9-871a-1997aaa3ec7b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:41.560635 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-e8470794-6615-420f-9651-2d17ad5aa89b req-fdc943eb-e1bb-43c9-871a-1997aaa3ec7b service nova] Creating event network-vif-plugged:929d3c0f-d941-4817-9998-3cb5f75695d3 for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 on hv-cinder-82282 Jul 14 11:28:41.565726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-e8470794-6615-420f-9651-2d17ad5aa89b req-fdc943eb-e1bb-43c9-871a-1997aaa3ec7b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Jul 14 11:28:41.566308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 577/1113] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:28:42.384311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:42.385242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:42.395153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:42.395870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:42.397024 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:42.397686 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:42.538073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:42.546027 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:42.547569 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:42.549079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-0f527553-4042-4651-8cd9-58809c941957 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.170834 Jul 14 11:28:42.550298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 537/1114] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:42 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:43.568699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:43.569402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:43.575944 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:43.576542 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:43.577257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:43.577732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:43.714423 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:43.724167 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:43.725670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:43.726873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a18c20e3-a371-4793-becf-92589e018279 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.163182 Jul 14 11:28:43.727456 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 578/1115] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:43 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 11:28:44.745495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:44.746362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:44.752858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:44.753316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:44.754101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:44.755116 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:44.888004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:44.896435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:44.897971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:44.899206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1d944aba-88f2-41eb-9bf6-4c4d5353a019 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1732 microversion: 2.20 time: 0.157621 Jul 14 11:28:44.899774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 538/1116] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:44 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:45.917684 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:45.918328 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:45.925046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:45.925497 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:45.926319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:45.926936 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:46.059924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:46.068336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:46.069842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:46.071009 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-79bfb1a2-d5b5-43d6-8f4a-467c486126f6 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1719 microversion: 2.20 time: 0.157240 Jul 14 11:28:46.071614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 579/1117] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:28:45 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:28:56.681569 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:56.682186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:56.684123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=17 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:56.684853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=13 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:56.685704 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=36 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:56.686239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=25 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:56.691339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:56.692157 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:56.693278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:56.693726 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:56.726251 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:28:56.757273 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-ababf349-360f-4f6f-ab22-3b4bde52feed req-4a66bf9a-0555-439e-b3ff-5b935d9ddf08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:28:56.765961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-ababf349-360f-4f6f-ab22-3b4bde52feed req-4a66bf9a-0555-439e-b3ff-5b935d9ddf08 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:56.766405 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-ababf349-360f-4f6f-ab22-3b4bde52feed req-4a66bf9a-0555-439e-b3ff-5b935d9ddf08 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:56.779088 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-ababf349-360f-4f6f-ab22-3b4bde52feed req-4a66bf9a-0555-439e-b3ff-5b935d9ddf08 service nova] Creating event network-changed:0cba2204-9945-44b4-b7d6-bf19dc81c7cc for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c on hv-cinder-82282 Jul 14 11:28:56.784710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-ababf349-360f-4f6f-ab22-3b4bde52feed req-4a66bf9a-0555-439e-b3ff-5b935d9ddf08 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109011 Jul 14 11:28:56.785382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 580/1118] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:28:57.083996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e8cf3fea-dfb0-46ab-8a9b-36f7a705f112 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 204 len: 0 microversion: 2.1 time: 0.408665 Jul 14 11:28:57.085785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 539/1119] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:28:56 2022] DELETE /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:28:57.094674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:57.095396 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:57.108717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:57.109746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:57.119929 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:57.119929 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:57.300699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:57.310942 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c7817f15-7709-4f71-a136-db944aacb985 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.220546 Jul 14 11:28:57.312291 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 581/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:57 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:28:58.329817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:58.330744 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:58.337770 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:58.338225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:58.339019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:58.339486 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:58.498580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:58.509451 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-59c76935-fd87-4e9d-b606-9fa0b924cc5d tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1566 microversion: 2.1 time: 0.183899 Jul 14 11:28:58.510044 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 540/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:58 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:28:59.529400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:28:59.530051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:28:59.537512 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:59.537988 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:59.538821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:28:59.539307 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:28:59.684248 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:28:59.693213 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5ab9a100-b93c-4022-9043-3346911adc67 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1447 microversion: 2.1 time: 0.167014 Jul 14 11:28:59.694047 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 582/1122] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:28:59 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:00.017786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-301177ae-2ea9-490d-bb9c-f0936321da7d req-3fcf80fa-7e02-43fc-83e0-1097eba551e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0fba6f-83bc-468c-aca3-c00c0a31611c", "name": "network-vif-deleted", "tag": "0cba2204-9945-44b4-b7d6-bf19dc81c7cc"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:00.026490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-301177ae-2ea9-490d-bb9c-f0936321da7d req-3fcf80fa-7e02-43fc-83e0-1097eba551e0 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:00.026944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-301177ae-2ea9-490d-bb9c-f0936321da7d req-3fcf80fa-7e02-43fc-83e0-1097eba551e0 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:00.038676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-301177ae-2ea9-490d-bb9c-f0936321da7d req-3fcf80fa-7e02-43fc-83e0-1097eba551e0 service nova] Creating event network-vif-deleted:0cba2204-9945-44b4-b7d6-bf19dc81c7cc for instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c on hv-cinder-82282 Jul 14 11:29:00.043577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-301177ae-2ea9-490d-bb9c-f0936321da7d req-3fcf80fa-7e02-43fc-83e0-1097eba551e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091609 Jul 14 11:29:00.044173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 541/1123] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:00.710349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:00.710969 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:00.718360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:00.718882 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:00.719620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:00.720055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:00.795650 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b84187a669e4849b3b9d02d8b337824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b8c45981fe4d48bf95dfbdd0804205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:00.808998 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c394d0ea-dfb7-40d1-b835-4ac19a922378 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 200 len: 1218 microversion: 2.1 time: 0.102686 Jul 14 11:29:00.809580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 583/1124] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:00 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:01.644155 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:01.645511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:01.652176 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:01.652687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:01.653554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:01.654030 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:01.682461 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e563a527-2f46-4c7a-9bd7-a3b13a90f2a5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/ips" status: 200 len: 146 microversion: 2.1 time: 0.043417 Jul 14 11:29:01.683054 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 542/1125] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:29:01 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:29:01.826267 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:01.826881 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] [instance: 1b0fba6f-83bc-468c-aca3-c00c0a31611c] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:01.834165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:01.834616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:01.835469 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:01.835855 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:01.850163 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] HTTP exception thrown: Instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c could not be found. Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Request method failure captured: Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c HTTP/1.1 Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_wyVQqF_-I0Im-vs6PkXf68xpNRJ1jTjOuw-iMGY9PCb2SjgiwBcrMIXuqXwElSi4esxbUsWVpG-4U0s8as0RjVsoEDwxV_Uazfx0usd_UsSJa68GAd1sN4jwZduuGidDVirwrQov_EsFMofT0uvqKTFwD2AHwiqMaPxc6PQopUhfw Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 81b8c45981fe4d48bf95dfbdd0804205 Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-TestShelveInstance-1841261030 Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:01.851951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81b8c45981fe4d48bf95dfbdd0804205", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81b8c45981fe4d48bf95dfbdd0804205"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81b8c45981fe4d48bf95dfbdd0804205"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81b8c45981fe4d48bf95dfbdd0804205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-TestShelveInstance-1841261030 Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 81b8c45981fe4d48bf95dfbdd0804205 Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-TestShelveInstance-1841261030 Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-TestShelveInstance-1841261030-project Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 6b84187a669e4849b3b9d02d8b337824 Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-TestShelveInstance-1841261030-project Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c could not be found. Jul 14 11:29:01.853679 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1b0fba6f-83bc-468c-aca3-c00c0a31611c'} Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c could not be found. Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:01.854823 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c could not be found. Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c could not be found. Jul 14 11:29:01.856552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:01.858070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Returning 404 to user: Instance 1b0fba6f-83bc-468c-aca3-c00c0a31611c could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:01.858070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7685976f-c2a8-4ae8-9105-89976df74572 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c" status: 404 len: 111 microversion: 2.1 time: 0.031490 Jul 14 11:29:01.858070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 584/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:01 2022] GET /compute/v2.1/servers/1b0fba6f-83bc-468c-aca3-c00c0a31611c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:29:02.098986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-49657db0-f80b-4b20-9dc1-9630be1de3b9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] Calling method '.version_select at 0x7f3416c48820>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:02.175139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-49657db0-f80b-4b20-9dc1-9630be1de3b9 tempest-TestShelveInstance-1841261030 tempest-TestShelveInstance-1841261030-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-695236922" status: 202 len: 0 microversion: 2.1 time: 0.079882 Jul 14 11:29:02.176321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 543/1127] 10.222.0.59 () {58 vars in 1250 bytes} [Thu Jul 14 11:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-695236922 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:29:04.425046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "058c9380-9550-4733-bbe6-b9b4c95c1e2a"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:04.426200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:04.432754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:04.433551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:04.434353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:04.434963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:05.320693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d0337e5c-7f54-4bdb-bfbc-94f593f3dbc8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899942 Jul 14 11:29:05.321225 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 585/1128] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:29:04 2022] POST /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:13.953969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:13.954809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:13.959256 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:13.962074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:13.967075 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:13.967550 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:13.968324 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:13.968760 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:13.999382 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-515ae4dd-c972-472f-86ae-2451dd084ec8 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046718 Jul 14 11:29:13.999944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 544/1129] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:29:13 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:14.011108 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:14.011710 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:14.018517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:14.018967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:14.020349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:14.020900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:14.049953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-54cb20f8-fbe8-4fca-98e4-85cf321e5049 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/058c9380-9550-4733-bbe6-b9b4c95c1e2a" status: 200 len: 194 microversion: 2.1 time: 0.043086 Jul 14 11:29:14.051673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 586/1130] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jul 14 11:29:14 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/058c9380-9550-4733-bbe6-b9b4c95c1e2a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:16.749616 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee004122-a9ab-4b49-9e58-5a3d09fcfda6"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:16.750698 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:16.758106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:16.758561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:16.759405 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:16.759851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:17.513954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b854a803-77ea-4314-b1b0-c370979a3767 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "POST /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769082 Jul 14 11:29:17.514568 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 545/1131] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:29:16 2022] POST /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:26.070040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:26.071517 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:26.074007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=14 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:26.074689 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:26.079653 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:26.080101 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:26.080875 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:26.081312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:26.111544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-df533ac0-534c-4fbd-bbd6-8ddf14301e6d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045394 Jul 14 11:29:26.112110 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 587/1132] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:29:26 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:26.252918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:26.253484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:26.260193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:26.260675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:26.261657 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:26.262100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:26.293068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2a8caa7d-a8a0-4052-99b7-dca6e0eeb36b tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/058c9380-9550-4733-bbe6-b9b4c95c1e2a" status: 200 len: 194 microversion: 2.1 time: 0.045100 Jul 14 11:29:26.293703 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 546/1133] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jul 14 11:29:26 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/058c9380-9550-4733-bbe6-b9b4c95c1e2a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:26.303513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:26.304003 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:26.311299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:26.311750 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:26.312509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:26.312939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:26.399891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lazy-loading 'services' on Instance uuid 55f0d168-ea3e-4b54-88cd-1607d647f68a {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:29:26.641206 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e809ed5b-db62-46a1-b75d-6caa626eab88 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/058c9380-9550-4733-bbe6-b9b4c95c1e2a" status: 202 len: 0 microversion: 2.1 time: 0.341356 Jul 14 11:29:26.641666 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 588/1134] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:29:26 2022] DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/058c9380-9550-4733-bbe6-b9b4c95c1e2a => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 11:29:28.814318 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:28.814868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:28.821538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:28.821993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:28.822772 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:28.823245 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:28.853409 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8c4adc7f-d6e6-4b3c-b041-f35d78b0feb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/ee004122-a9ab-4b49-9e58-5a3d09fcfda6" status: 200 len: 194 microversion: 2.1 time: 0.042905 Jul 14 11:29:28.854001 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 547/1135] 10.222.0.59 () {58 vars in 1412 bytes} [Thu Jul 14 11:29:28 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/ee004122-a9ab-4b49-9e58-5a3d09fcfda6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:28.865154 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:28.865736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:28.872883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:28.873336 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:28.874113 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:28.874553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:28.955941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lazy-loading 'services' on Instance uuid 55f0d168-ea3e-4b54-88cd-1607d647f68a {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:29:29.172132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e0446f61-d3a8-4ebc-aa0b-d978058b4de1 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/ee004122-a9ab-4b49-9e58-5a3d09fcfda6" status: 202 len: 0 microversion: 2.1 time: 0.311759 Jul 14 11:29:29.172814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 589/1136] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:29:28 2022] DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments/ee004122-a9ab-4b49-9e58-5a3d09fcfda6 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:29:31.391716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:31.392680 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:31.399559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.400012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.400789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.401227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.432853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-91640d0e-caef-4241-bca8-06cb51ecfc2d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044885 Jul 14 11:29:31.433324 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 548/1137] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:29:31 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:29:31.538775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:31.540408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:31.546758 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.547242 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.548019 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.548462 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.578260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b7f5b9c3-e7e9-4cfa-9213-a74891ac7c3d tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044247 Jul 14 11:29:31.578934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 590/1138] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:29:31 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:29:31.637312 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:31.637836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:31.644126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.644573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.645348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.645781 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.670982 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:29:31.944172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c146c51f-86ee-4bde-8075-f07573d6b83e tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 204 len: 0 microversion: 2.1 time: 0.310411 Jul 14 11:29:31.944862 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 549/1139] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:31 2022] DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:29:31.953105 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:31.953749 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:31.960092 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.960543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:31.961868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:31.962344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:32.113895 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:32.122501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4664b06f-1111-4ae4-832c-8f94db729d0a tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1673 microversion: 2.1 time: 0.173305 Jul 14 11:29:32.123082 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 591/1140] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:31 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:33.141156 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:33.141860 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:33.148476 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:33.148929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:33.149711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:33.150143 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:33.291953 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:33.300941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-de108c37-1aba-46d2-be17-951b14c44857 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1673 microversion: 2.1 time: 0.163295 Jul 14 11:29:33.300941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 550/1141] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:33 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:34.318950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:34.319581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:34.326941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:34.327425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:34.328205 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:34.328642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:34.468258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:34.480327 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-01c81429-7775-4ad5-a6c7-e872da75d688 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1673 microversion: 2.1 time: 0.165236 Jul 14 11:29:34.480925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 592/1142] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:34 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:35.266206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-0816264b-44a9-4698-8f94-78bb9e31d413 req-0bfe2d6f-227b-45c1-b2e0-72e3857dd4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55f0d168-ea3e-4b54-88cd-1607d647f68a", "name": "network-vif-deleted", "tag": "16bfd6f1-89ae-480c-b717-d4875d429874"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:35.274397 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-0816264b-44a9-4698-8f94-78bb9e31d413 req-0bfe2d6f-227b-45c1-b2e0-72e3857dd4b4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:35.279805 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-0816264b-44a9-4698-8f94-78bb9e31d413 req-0bfe2d6f-227b-45c1-b2e0-72e3857dd4b4 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:35.286999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-0816264b-44a9-4698-8f94-78bb9e31d413 req-0bfe2d6f-227b-45c1-b2e0-72e3857dd4b4 service nova] Creating event network-vif-deleted:16bfd6f1-89ae-480c-b717-d4875d429874 for instance 55f0d168-ea3e-4b54-88cd-1607d647f68a on hv-cinder-82282 Jul 14 11:29:35.292455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-0816264b-44a9-4698-8f94-78bb9e31d413 req-0bfe2d6f-227b-45c1-b2e0-72e3857dd4b4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030683 Jul 14 11:29:35.293073 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 551/1143] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:35.501893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:35.502680 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:35.508880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:35.510869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:35.512061 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:35.512503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:35.578130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ebc96dc6b16411a9adb8e91793cda07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf0cfc65d914753b1e19db9e238b4dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:35.591827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ba1a3555-5f29-4a84-9cf5-8a207981a47c tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 200 len: 1321 microversion: 2.1 time: 0.093804 Jul 14 11:29:35.592655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 593/1144] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:35 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:36.611022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:36.611783 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:36.618089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:36.618544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:36.620364 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:36.620815 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:36.635112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] HTTP exception thrown: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Request method failure captured: Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a HTTP/1.1 Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_ujfws38EoVjL7TI-V3N9pv9_N1tXaSjkfCJDSuA35Ks4zp0Hv2EfMmNpWj88v5o-ZfHW3ZIGco1EI6pZGRqBo361w4iTAYi3injzatf9Ca4a8clB6sZuAGGNRcGqV4H7CG9jdO6ym8-HqyUwXninJw-HhzRcEzJdrmen3FFw-HL1o Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:29:36.636787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6cf0cfc65d914753b1e19db9e238b4dd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 4ebc96dc6b16411a9adb8e91793cda07 Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:36.638449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '55f0d168-ea3e-4b54-88cd-1607d647f68a'} Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:36.639395 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:36.640918 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:36.642241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Returning 404 to user: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:36.642241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-84969098-33d4-4ad2-8928-1509ffeae623 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 404 len: 111 microversion: 2.1 time: 0.032321 Jul 14 11:29:36.642241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 552/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:36 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:36.647510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b09f9023-0b10-4717-9f42-f48568be1af5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '.version_select at 0x7f3412254e50>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:36.733513 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b09f9023-0b10-4717-9f42-f48568be1af5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-854508281" status: 202 len: 0 microversion: 2.1 time: 0.089871 Jul 14 11:29:36.734116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 594/1146] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jul 14 11:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-854508281 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:29:40.165391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:40.165930 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:40.178493 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:40.182784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:40.182784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:40.182784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:40.195361 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] HTTP exception thrown: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Request method failure captured: Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a HTTP/1.1 Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_ujfws38EoVjL7TI-V3N9pv9_N1tXaSjkfCJDSuA35Ks4zp0Hv2EfMmNpWj88v5o-ZfHW3ZIGco1EI6pZGRqBo361w4iTAYi3injzatf9Ca4a8clB6sZuAGGNRcGqV4H7CG9jdO6ym8-HqyUwXninJw-HhzRcEzJdrmen3FFw-HL1o Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:29:40.196928 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6cf0cfc65d914753b1e19db9e238b4dd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 4ebc96dc6b16411a9adb8e91793cda07 Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.199322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '55f0d168-ea3e-4b54-88cd-1607d647f68a'} Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:40.200158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.201712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.203396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Returning 404 to user: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:40.203396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ff4e3784-aa30-41e6-bb50-87a0a39e4ed5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 404 len: 111 microversion: 2.1 time: 0.037968 Jul 14 11:29:40.203396 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 553/1147] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:40 2022] DELETE /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:40.208531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:40.209175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 55f0d168-ea3e-4b54-88cd-1607d647f68a] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:40.216390 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:40.217176 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:40.217688 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:40.218130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:40.231642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] HTTP exception thrown: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Request method failure captured: Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a HTTP/1.1 Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_ujfws38EoVjL7TI-V3N9pv9_N1tXaSjkfCJDSuA35Ks4zp0Hv2EfMmNpWj88v5o-ZfHW3ZIGco1EI6pZGRqBo361w4iTAYi3injzatf9Ca4a8clB6sZuAGGNRcGqV4H7CG9jdO6ym8-HqyUwXninJw-HhzRcEzJdrmen3FFw-HL1o Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:40.233417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6cf0cfc65d914753b1e19db9e238b4dd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 4ebc96dc6b16411a9adb8e91793cda07 Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.234961 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '55f0d168-ea3e-4b54-88cd-1607d647f68a'} Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:40.236070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. Jul 14 11:29:40.237543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:40.238903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Returning 404 to user: Instance 55f0d168-ea3e-4b54-88cd-1607d647f68a could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:40.238903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ec7659dc-13d2-4c0a-9855-2f0fb1473eb5 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a" status: 404 len: 111 microversion: 2.1 time: 0.030595 Jul 14 11:29:40.238903 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 595/1148] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:40 2022] GET /compute/v2.1/servers/55f0d168-ea3e-4b54-88cd-1607d647f68a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:41.535017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:41.535544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:41.543559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:41.543559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:41.544362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:41.544798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:41.558541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] HTTP exception thrown: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Request method failure captured: Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d HTTP/1.1 Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_ujfws38EoVjL7TI-V3N9pv9_N1tXaSjkfCJDSuA35Ks4zp0Hv2EfMmNpWj88v5o-ZfHW3ZIGco1EI6pZGRqBo361w4iTAYi3injzatf9Ca4a8clB6sZuAGGNRcGqV4H7CG9jdO6ym8-HqyUwXninJw-HhzRcEzJdrmen3FFw-HL1o Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:29:41.560108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6cf0cfc65d914753b1e19db9e238b4dd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 4ebc96dc6b16411a9adb8e91793cda07 Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.561699 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '0e3c6670-5e21-4f8e-93c1-66a524a5510d'} Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:41.562746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.564246 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.565802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Returning 404 to user: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:41.565802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5edc08a8-c808-490f-8ae7-4118fd5903d4 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 404 len: 111 microversion: 2.1 time: 0.030316 Jul 14 11:29:41.565802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 554/1149] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:41 2022] DELETE /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:41.569884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:41.570591 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] [instance: 0e3c6670-5e21-4f8e-93c1-66a524a5510d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:41.577602 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:41.578046 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:41.578821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:41.579293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:41.593484 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] HTTP exception thrown: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Request method failure captured: Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d HTTP/1.1 Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_ujfws38EoVjL7TI-V3N9pv9_N1tXaSjkfCJDSuA35Ks4zp0Hv2EfMmNpWj88v5o-ZfHW3ZIGco1EI6pZGRqBo361w4iTAYi3injzatf9Ca4a8clB6sZuAGGNRcGqV4H7CG9jdO6ym8-HqyUwXninJw-HhzRcEzJdrmen3FFw-HL1o Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:41.595016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6cf0cfc65d914753b1e19db9e238b4dd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6cf0cfc65d914753b1e19db9e238b4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 6cf0cfc65d914753b1e19db9e238b4dd Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeTestJSON-340885874 Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 4ebc96dc6b16411a9adb8e91793cda07 Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeTestJSON-340885874-project Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.596620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '0e3c6670-5e21-4f8e-93c1-66a524a5510d'} Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:41.597483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. Jul 14 11:29:41.598701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:41.599854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] Returning 404 to user: Instance 0e3c6670-5e21-4f8e-93c1-66a524a5510d could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:41.599854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-36024915-be70-4059-b288-88c043a251d2 tempest-AttachVolumeTestJSON-340885874 tempest-AttachVolumeTestJSON-340885874-project] 10.222.0.59 "GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d" status: 404 len: 111 microversion: 2.1 time: 0.030355 Jul 14 11:29:41.599854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 596/1150] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:41 2022] GET /compute/v2.1/servers/0e3c6670-5e21-4f8e-93c1-66a524a5510d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:29:43.099861 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:43.100668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:43.108005 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.108457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.109441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.109879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.141712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7f759dc0-bf42-44bf-a483-91b704ae4179 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046032 Jul 14 11:29:43.142417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 555/1151] 10.222.0.59 () {60 vars in 1342 bytes} [Thu Jul 14 11:29:43 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:43.222244 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:43.223293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:43.231857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.232704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.233980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.234704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.262795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:29:43.534500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-33e8c0ab-cf6e-42c3-a280-77b2fe5df7a1 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 204 len: 0 microversion: 2.20 time: 0.316008 Jul 14 11:29:43.538424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 597/1152] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jul 14 11:29:43 2022] DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 11:29:43.543722 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:43.544325 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:43.551584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.552159 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.553063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.553528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.968284 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:43.969694 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:43.971860 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:43.977450 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.983256 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.983976 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:43.984798 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:43.985479 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:43.985850 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:43.987282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7b562720-149a-405b-b3d2-e6d27d58b256 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.447726 Jul 14 11:29:43.988183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 556/1153] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:43 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:29:44.035622 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:29:44.311268 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-405ba05e-a7e7-401c-9170-beedb7cb749f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 204 len: 0 microversion: 2.1 time: 0.347820 Jul 14 11:29:44.312039 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 598/1154] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:29:43 2022] DELETE /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 11:29:44.320470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:44.321083 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:44.328681 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:44.329322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:44.330778 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:44.331097 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:44.528544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:44.536775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-880cd864-528d-45f3-839f-31a777a24462 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1578 microversion: 2.1 time: 0.220044 Jul 14 11:29:44.537371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 557/1155] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:44 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:45.007309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:45.008025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:45.016669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.017403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.019028 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.019683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.274220 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:45.283480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:45.285170 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:45.286743 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-af115b45-c09c-4548-9c08-ed5ccb111934 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.284005 Jul 14 11:29:45.287687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 599/1156] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:45 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:29:45.555538 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:45.556448 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:45.563460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.563990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.564864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:45.565373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:45.710792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:45.720480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7ce838e0-47de-4077-9704-a1386abb78dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1578 microversion: 2.1 time: 0.169021 Jul 14 11:29:45.721112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 558/1157] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:45 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:46.309402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:46.310441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:46.323021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:46.323021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:46.323021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:46.323021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:46.470266 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:46.482529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:46.484382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:46.485743 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-28015eea-6f20-49a1-bf71-2f6247a2250f tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1725 microversion: 2.20 time: 0.183438 Jul 14 11:29:46.486460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 600/1158] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:46 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:29:46.738829 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:46.739504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:46.750019 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:46.750693 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:46.751534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:46.751992 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:46.956444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:46.958389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:46.965866 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-82c371a2-3bf8-4886-ab33-5f40eba24ddf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1578 microversion: 2.1 time: 0.231026 Jul 14 11:29:46.966678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 559/1159] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:46 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:47.509026 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:47.511290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:47.522585 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:47.523606 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:47.524640 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:47.529230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:47.577027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:47.629403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:47.638354 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:47.640389 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:47.641778 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-628cb86d-1326-4bed-ad28-dcfc7f3518bc tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1658 microversion: 2.20 time: 0.139668 Jul 14 11:29:47.642544 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 601/1160] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:47 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1658 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:29:47.895515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-930a5b95-a767-4672-b696-9d6574838b3d req-ee807a84-749c-46b4-bea2-1d90edbee7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435b5cca-1893-4891-9f5c-45cf76ac4f67", "name": "network-vif-deleted", "tag": "929d3c0f-d941-4817-9998-3cb5f75695d3"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:47.904851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:47.909695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-930a5b95-a767-4672-b696-9d6574838b3d req-ee807a84-749c-46b4-bea2-1d90edbee7ab service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:47.910440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-930a5b95-a767-4672-b696-9d6574838b3d req-ee807a84-749c-46b4-bea2-1d90edbee7ab service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:47.925326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-930a5b95-a767-4672-b696-9d6574838b3d req-ee807a84-749c-46b4-bea2-1d90edbee7ab service nova] Creating event network-vif-deleted:929d3c0f-d941-4817-9998-3cb5f75695d3 for instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 on hv-cinder-82282 Jul 14 11:29:47.930880 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-930a5b95-a767-4672-b696-9d6574838b3d req-ee807a84-749c-46b4-bea2-1d90edbee7ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039100 Jul 14 11:29:47.937015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 560/1161] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:47.991099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:47.991099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:48.000161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.000930 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.001993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.002624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.230724 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-3c02d048-2107-4ecf-8796-f3fc78800037 req-73d81eff-a2b8-4265-8987-12196e5feaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1beae9bb-3e63-453f-9262-7d2b446ea357", "name": "network-vif-deleted", "tag": "b634c1af-ed40-40e7-a037-e3aa95ce980e"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:48.236770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:48.252841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-3c02d048-2107-4ecf-8796-f3fc78800037 req-73d81eff-a2b8-4265-8987-12196e5feaea service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.255586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-3c02d048-2107-4ecf-8796-f3fc78800037 req-73d81eff-a2b8-4265-8987-12196e5feaea service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.257299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e70160a8-697e-4ae1-a49a-0b944ba45e42 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1510 microversion: 2.1 time: 0.260359 Jul 14 11:29:48.265788 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 602/1162] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:47 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:48.287574 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-3c02d048-2107-4ecf-8796-f3fc78800037 req-73d81eff-a2b8-4265-8987-12196e5feaea service nova] Creating event network-vif-deleted:b634c1af-ed40-40e7-a037-e3aa95ce980e for instance 1beae9bb-3e63-453f-9262-7d2b446ea357 on hv-cinder-82282 Jul 14 11:29:48.315596 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-3c02d048-2107-4ecf-8796-f3fc78800037 req-73d81eff-a2b8-4265-8987-12196e5feaea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085178 Jul 14 11:29:48.316289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 561/1163] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:48.663786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:48.665053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:48.673754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.674506 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.675534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.676181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.722592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:48.723402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:48.724049 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lazy-loading 'fault' on Instance uuid 435b5cca-1893-4891-9f5c-45cf76ac4f67 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:29:48.780286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:48.792568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:48.805123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ac486b2d0ac42f9ba2fed7b17418b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33c57605a974b44a62eebbdaba23ade', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:48.807045 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ffd90e43-00dc-4ae1-b08b-457be7c52f4c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 200 len: 1372 microversion: 2.20 time: 0.149297 Jul 14 11:29:48.807804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 603/1164] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:48 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 11:29:49.285076 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:49.285702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:49.294920 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.295394 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.296187 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.296624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.330494 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.331157 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.331757 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lazy-loading 'fault' on Instance uuid 1beae9bb-3e63-453f-9262-7d2b446ea357 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:29:49.388727 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:49.397472 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-63aaf604-90e0-4b98-af37-541a8cecad28 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 200 len: 1230 microversion: 2.1 time: 0.118680 Jul 14 11:29:49.398063 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 562/1165] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:49 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:49.826791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:49.827443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:49.833937 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.836989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.836989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:49.836989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:49.851700 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] HTTP exception thrown: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Request method failure captured: Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 HTTP/1.1 Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s5XC7P8LTY0_sTqTTMMyjqOQ1FVTjPozv-Ja7wMg9697loLGRXsNXr2CU0-hEdX61raejfojElET7cbpHWdOraiTJZUJ_OLNVA4Zwk9p5m0QtQ7POI6WK1iFpUtSVM1FTbSwHbqkjh2k0buDVuCsPCce1rHyHMFQqOE3fSm53Qt9c Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:49.853644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f33c57605a974b44a62eebbdaba23ade", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3ac486b2d0ac42f9ba2fed7b17418b7a Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:49.855827 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '435b5cca-1893-4891-9f5c-45cf76ac4f67'} Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:49.856723 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:49.858346 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:49.859726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Returning 404 to user: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:49.859726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7ec59763-4688-4eec-adde-963efa41794d tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 404 len: 111 microversion: 2.20 time: 0.033240 Jul 14 11:29:49.860432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 604/1166] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:49 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:29:49.870951 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f10eea10-2088-4fe0-939b-443ff141fab3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '.version_select at 0x7f3412a98ee0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:49.944819 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f10eea10-2088-4fe0-939b-443ff141fab3 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398829927" status: 204 len: 0 microversion: 2.20 time: 0.078740 Jul 14 11:29:49.946890 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 563/1167] 10.222.0.59 () {60 vars in 1261 bytes} [Thu Jul 14 11:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398829927 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 11:29:50.415623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:50.416487 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:50.422601 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:50.423072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:50.423864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:50.424293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:50.440087 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] HTTP exception thrown: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Request method failure captured: Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 HTTP/1.1 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_1Cz2M9OX7lCI5Xeh7xYqLFPclc15vC5P0P8HFBkzxgIfJ5fjYtm-IyLcT9eQsvmYsa1AkddcQZRS5WUOkub-v80c0Wr4NMngNocnhVosW2kjrMC6FqZTU8Ofw-TymhhT1vvNR73V0nmMjwczblz4C34dh6HCChb6Vh7wyiIe4nxg0 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:50.441616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f3904fb55e2e463fb548333d97601ce5", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: c466157931bd41baabb01abbec492b4f Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:29:50.454876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1beae9bb-3e63-453f-9262-7d2b446ea357'} Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:50.455867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:29:50.458022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:50.459358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Returning 404 to user: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:50.459358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d021b849-5f83-4f3d-b945-f9928c7475e4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 404 len: 111 microversion: 2.1 time: 0.031367 Jul 14 11:29:50.459358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 605/1168] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:50 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:29:50.547321 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1746115624", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1262803912", "security_groups": [{"name": "tempest-secgroup-smoke-1603179061"}], "block_device_mapping_v2": [{"uuid": "339daa40-2cb7-4589-b2e4-9fb6dc1f0265", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dcd81d06-0465-420e-871c-9fad1baf38d1"}]}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:50.751371 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] validate_networks() for [('dcd81d06-0465-420e-871c-9fad1baf38d1', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:29:51.284231 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:29:51.284687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:29:51.285153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:29:51.285559 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:29:51.286098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:29:51.298077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:51.298521 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:51.299367 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:51.299794 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:51.318631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for project f3904fb55e2e463fb548333d97601ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:29:51.323942 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for user c466157931bd41baabb01abbec492b4f and project f3904fb55e2e463fb548333d97601ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:29:51.387946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:29:51.387946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='339daa40-2cb7-4589-b2e4-9fb6dc1f0265',volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:29:51.778955 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4b6a664b-b54b-42b9-b7d8-8e66802b0356 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.235831 Jul 14 11:29:51.781213 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 564/1169] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:29:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:29:51.789804 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-18b308f2-aa1f-4b25-b1ab-9daa19f061d9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:51.790342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-18b308f2-aa1f-4b25-b1ab-9daa19f061d9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:51.850230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-18b308f2-aa1f-4b25-b1ab-9daa19f061d9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:51.860006 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-18b308f2-aa1f-4b25-b1ab-9daa19f061d9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1095 microversion: 2.1 time: 0.073990 Jul 14 11:29:51.861557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 606/1170] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:51 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:52.038902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:52.039442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:52.049477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:52.049855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:52.050647 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:52.051086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:52.065601 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] HTTP exception thrown: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Request method failure captured: Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 HTTP/1.1 Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_s5XC7P8LTY0_sTqTTMMyjqOQ1FVTjPozv-Ja7wMg9697loLGRXsNXr2CU0-hEdX61raejfojElET7cbpHWdOraiTJZUJ_OLNVA4Zwk9p5m0QtQ7POI6WK1iFpUtSVM1FTbSwHbqkjh2k0buDVuCsPCce1rHyHMFQqOE3fSm53Qt9c Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:29:52.067384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f33c57605a974b44a62eebbdaba23ade", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 3ac486b2d0ac42f9ba2fed7b17418b7a Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.069153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '435b5cca-1893-4891-9f5c-45cf76ac4f67'} Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:52.070020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.071541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.073208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Returning 404 to user: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:52.073208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-73875f5e-2ec6-430a-aa01-6c119869e60c tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 404 len: 111 microversion: 2.20 time: 0.033883 Jul 14 11:29:52.073208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 565/1171] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jul 14 11:29:52 2022] DELETE /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:29:52.078582 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:52.079250 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: 435b5cca-1893-4891-9f5c-45cf76ac4f67] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:52.086494 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:52.088027 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:52.088357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:52.088801 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:52.102497 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] HTTP exception thrown: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Request method failure captured: Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 HTTP/1.1 Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s5XC7P8LTY0_sTqTTMMyjqOQ1FVTjPozv-Ja7wMg9697loLGRXsNXr2CU0-hEdX61raejfojElET7cbpHWdOraiTJZUJ_OLNVA4Zwk9p5m0QtQ7POI6WK1iFpUtSVM1FTbSwHbqkjh2k0buDVuCsPCce1rHyHMFQqOE3fSm53Qt9c Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:52.104753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f33c57605a974b44a62eebbdaba23ade", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3ac486b2d0ac42f9ba2fed7b17418b7a Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.106886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '435b5cca-1893-4891-9f5c-45cf76ac4f67'} Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:52.107924 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. Jul 14 11:29:52.109716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:52.111367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Returning 404 to user: Instance 435b5cca-1893-4891-9f5c-45cf76ac4f67 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:52.111367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-169e221c-6d46-4af9-b181-2394ee1bfbff tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67" status: 404 len: 111 microversion: 2.20 time: 0.031770 Jul 14 11:29:52.111367 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 607/1172] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:52 2022] GET /compute/v2.1/servers/435b5cca-1893-4891-9f5c-45cf76ac4f67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:29:52.878884 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:52.879475 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:52.886844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:52.887333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:52.888116 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:52.888557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:52.950588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:52.958133 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-afc31a56-f133-413f-9b4b-eecc09d25565 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1145 microversion: 2.1 time: 0.083385 Jul 14 11:29:52.958716 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 566/1173] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:52 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:53.975989 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:53.976704 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:53.984277 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:53.984720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:53.985495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:53.985938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:54.049329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:54.058246 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0fe94a12-561c-42d3-94cb-2bdff6e5f2f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1145 microversion: 2.1 time: 0.086001 Jul 14 11:29:54.058826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 608/1174] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:53 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:55.076086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:55.076741 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:55.083342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:55.083794 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:55.084565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:55.085000 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:55.148067 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:55.155496 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2c1925fb-2126-46cc-a971-c09a649150d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1137 microversion: 2.1 time: 0.083914 Jul 14 11:29:55.156070 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 567/1175] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:55 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:56.174077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:56.182032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:56.182032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:56.182032 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:56.182316 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:56.183818 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:56.187605 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:56.279907 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:56.287795 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-94ec4b15-b710-4411-b9c1-70073f6298a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1201 microversion: 2.1 time: 0.118473 Jul 14 11:29:56.288363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 609/1176] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:56 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1201 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:56.567851 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:56.568526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:56.576302 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:56.576446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:56.577203 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:56.577798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:56.596515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] HTTP exception thrown: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Request method failure captured: Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 HTTP/1.1 Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_s5XC7P8LTY0_sTqTTMMyjqOQ1FVTjPozv-Ja7wMg9697loLGRXsNXr2CU0-hEdX61raejfojElET7cbpHWdOraiTJZUJ_OLNVA4Zwk9p5m0QtQ7POI6WK1iFpUtSVM1FTbSwHbqkjh2k0buDVuCsPCce1rHyHMFQqOE3fSm53Qt9c Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:29:56.598098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f33c57605a974b44a62eebbdaba23ade", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 3ac486b2d0ac42f9ba2fed7b17418b7a Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.601022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': 'a91745f1-a0c6-47f3-8c7b-da031d0dc625'} Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:56.601952 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.603480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.606040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Returning 404 to user: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:56.606040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f07bd8ca-5fde-42c3-82ef-581fa7426ab4 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 404 len: 111 microversion: 2.20 time: 0.036009 Jul 14 11:29:56.606040 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 568/1177] 10.222.0.59 () {60 vars in 1279 bytes} [Thu Jul 14 11:29:56 2022] DELETE /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 11:29:56.611218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:56.615357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] [instance: a91745f1-a0c6-47f3-8c7b-da031d0dc625] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:56.620911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:56.621391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:56.622498 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:56.622947 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:56.639861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] HTTP exception thrown: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Request method failure captured: Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 HTTP/1.1 Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_s5XC7P8LTY0_sTqTTMMyjqOQ1FVTjPozv-Ja7wMg9697loLGRXsNXr2CU0-hEdX61raejfojElET7cbpHWdOraiTJZUJ_OLNVA4Zwk9p5m0QtQ7POI6WK1iFpUtSVM1FTbSwHbqkjh2k0buDVuCsPCce1rHyHMFQqOE3fSm53Qt9c Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:29:56.643702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f33c57605a974b44a62eebbdaba23ade", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f33c57605a974b44a62eebbdaba23ade"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f33c57605a974b44a62eebbdaba23ade Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-818401901 Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 3ac486b2d0ac42f9ba2fed7b17418b7a Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeShelveTestJSON-818401901-project Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.645415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'a91745f1-a0c6-47f3-8c7b-da031d0dc625'} Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:29:56.646312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. Jul 14 11:29:56.647846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:29:56.649161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] Returning 404 to user: Instance a91745f1-a0c6-47f3-8c7b-da031d0dc625 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:29:56.649161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2b75e01a-3621-4db2-9ba5-817990dfe131 tempest-AttachVolumeShelveTestJSON-818401901 tempest-AttachVolumeShelveTestJSON-818401901-project] 10.222.0.59 "GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625" status: 404 len: 111 microversion: 2.20 time: 0.037261 Jul 14 11:29:56.649161 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 610/1178] 10.222.0.59 () {60 vars in 1276 bytes} [Thu Jul 14 11:29:56 2022] GET /compute/v2.1/servers/a91745f1-a0c6-47f3-8c7b-da031d0dc625 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:29:57.306077 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:57.309072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:57.321871 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:57.322373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:57.323864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:57.325178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:57.581368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:57.590456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cff2bb71-e834-4fc0-a1e3-5343b28dfa49 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1279 microversion: 2.1 time: 0.287962 Jul 14 11:29:57.600886 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 569/1179] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:57 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:58.212717 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-85c1e24b-6a14-4514-9a14-592eb97d8f59 req-2e279b3c-80a8-4f36-af4f-a0d8623a0dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30581246-1a52-4bcf-ae18-ca92ecd7366e", "tag": "adeb76b3-7b8e-4d92-bddc-fcfc90be61cf"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:29:58.226724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-85c1e24b-6a14-4514-9a14-592eb97d8f59 req-2e279b3c-80a8-4f36-af4f-a0d8623a0dde service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:58.227187 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-85c1e24b-6a14-4514-9a14-592eb97d8f59 req-2e279b3c-80a8-4f36-af4f-a0d8623a0dde service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:58.247037 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-85c1e24b-6a14-4514-9a14-592eb97d8f59 req-2e279b3c-80a8-4f36-af4f-a0d8623a0dde service nova] Creating event network-changed:adeb76b3-7b8e-4d92-bddc-fcfc90be61cf for instance 30581246-1a52-4bcf-ae18-ca92ecd7366e on hv-cinder-82282 Jul 14 11:29:58.252313 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-85c1e24b-6a14-4514-9a14-592eb97d8f59 req-2e279b3c-80a8-4f36-af4f-a0d8623a0dde service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045397 Jul 14 11:29:58.253285 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 611/1180] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:29:58.607415 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:58.608792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:58.616597 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:58.617135 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:58.618190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:58.618632 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:58.762332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:29:58.771401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-361f4e7d-ae5c-45e6-a8cf-d5dd9c5b1c22 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.167908 Jul 14 11:29:58.772192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 570/1181] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:58 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:29:59.790693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:29:59.791590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:29:59.798326 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:59.798775 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:29:59.799587 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:29:59.800031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:00.085257 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:00.098837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-216cae97-3578-4d5d-92f0-3c49edd33540 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.312810 Jul 14 11:30:00.101882 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 612/1182] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:29:59 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:01.118971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:01.120093 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:01.127101 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:01.127580 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:01.128368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:01.128840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:01.308914 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:01.348297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:01.348297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:01.348297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7b254a5c-1979-48ea-84b1-bb99bd5ee64b tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.229820 Jul 14 11:30:01.348297 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 571/1183] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:01 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:02.361753 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:02.362510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:02.365066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:02.370790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:02.371298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:02.372074 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:02.372543 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:02.516504 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:02.524314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4f2aa8f8-2a62-4b55-b495-22eb53adc6c4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.166247 Jul 14 11:30:02.524857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 613/1184] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:02 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:03.543288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:03.543902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:03.551526 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:03.551978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:03.552745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:03.553178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:03.700344 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:03.707926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b60296d4-4786-4536-8c68-99379bad78e5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.169683 Jul 14 11:30:03.708490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 572/1185] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:03 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:04.725891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:04.726510 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:04.734614 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:04.736482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:04.736482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:04.736482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:04.968551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:04.975984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ffbff698-aa3b-4210-a389-07a527f901e6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.254378 Jul 14 11:30:04.976537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 614/1186] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:04 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:05.999901 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:06.000506 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:06.009478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:06.010009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:06.010828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:06.011370 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:06.252167 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:06.266210 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fea1d4e6-176c-414e-a976-b17679b0cec9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.270684 Jul 14 11:30:06.267387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 573/1187] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:05 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:07.285061 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:07.285666 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:07.293198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:07.293820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:07.294618 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:07.295282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:07.447807 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:07.456217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-59e5d5e3-9a55-4406-b050-15784de65ae0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.175002 Jul 14 11:30:07.467609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 615/1188] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:07 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:08.474342 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:08.474967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:08.483932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:08.484484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:08.485348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:08.485858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:08.705247 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:08.714369 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2d178e0d-c6fa-422c-b781-ceaa6c459f34 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.244122 Jul 14 11:30:08.725042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 574/1189] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:08 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:09.286216 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-242fa46a-ff98-4961-926f-566773982ced tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: .version_select at 0x7f341249b8b0>, body: {"keypair": {"name": "tempest-keypair-981276794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlQJwaU/atkdNSrXinqJKxfEihiI+ZZBsuDeZjGba6v2Cvxprj9qW+sECZOrWEUoXbkNzOqgUOTEM6KsD9db8aR9lTLE3VU/WljYCR24k+woP0rNQyqwgwWURLdWz7nRQ=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:09.302362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-242fa46a-ff98-4961-926f-566773982ced tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:30:09.307832 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-242fa46a-ff98-4961-926f-566773982ced tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:30:09.402320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-242fa46a-ff98-4961-926f-566773982ced tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.260428 Jul 14 11:30:09.403030 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 616/1190] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:30:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:30:09.732174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:09.732800 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:09.739497 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:09.739945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:09.740717 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:09.741366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:09.888198 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:09.895714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-83cdb7f6-418a-455f-8084-904f829fead6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.167511 Jul 14 11:30:09.896285 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 575/1191] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:09 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:10.913555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:10.918224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:10.935541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:10.939298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:10.940280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:10.940878 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:11.266369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:11.283018 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bf5d2d58-fc1c-4575-844e-29591f6bd982 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.373357 Jul 14 11:30:11.283732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 617/1192] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:10 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:12.315540 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:12.316282 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:12.331659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:12.335250 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:12.336919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:12.337583 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:12.618626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:12.632647 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8dd562c1-e3e3-4ca6-b5ed-39daac8ba8d4 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.330250 Jul 14 11:30:12.645139 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 576/1193] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:12 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:12.697443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-571675487", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d0793d7-484a-4624-89ee-2256db3098b1"}], "security_groups": [{"name": "tempest-securitygroup--1359593039"}], "key_name": "tempest-keypair-981276794", "user_data": "}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:12.898272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] validate_networks() for [('7d0793d7-484a-4624-89ee-2256db3098b1', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:30:13.514188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:30:13.514872 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:30:13.515353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:30:13.515836 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:30:13.516893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:30:13.529590 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:13.530034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:13.530852 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:13.531335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:13.564125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:30:13.564125 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:30:13.566172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:30:13.568660 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:30:13.654211 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:13.654950 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:13.663594 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:13.664050 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:13.664893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:13.665531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:13.724165 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c72ab086-c507-4ff2-8e00-ab7f842d28d4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.031229 Jul 14 11:30:13.731240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 618/1194] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:30:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:30:13.736391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-424daadb-1f07-49db-815e-5dd5658ff70b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:13.737247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-424daadb-1f07-49db-815e-5dd5658ff70b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:13.839844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:13.849401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6661393e-191a-4a44-8ae7-53145579840c tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.200382 Jul 14 11:30:13.850004 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 577/1195] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:13 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:14.085803 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-424daadb-1f07-49db-815e-5dd5658ff70b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:14.093645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-424daadb-1f07-49db-815e-5dd5658ff70b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1240 microversion: 2.1 time: 0.360994 Jul 14 11:30:14.094226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 619/1196] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:13 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1240 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:14.866350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:14.866961 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:14.874189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:14.874643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:14.875447 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:14.875888 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:15.018680 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:15.027175 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cdff87e5-5e38-4071-9552-37b44f46238f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.164674 Jul 14 11:30:15.027755 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 578/1197] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:14 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:15.110992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:15.111554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:15.118190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:15.118980 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:15.120597 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:15.120921 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:15.185950 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:15.193641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ec71e7ef-c5bd-41a0-a5b5-8d8f54f62b1e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1244 microversion: 2.1 time: 0.086636 Jul 14 11:30:15.194224 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 620/1198] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:15 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:16.044751 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:16.045394 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:16.052112 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:16.052569 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:16.053354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:16.053798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:16.196328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:16.204147 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-861062db-25e3-4884-892b-83b6f9c6c82e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.163841 Jul 14 11:30:16.204848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 579/1199] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:16 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:16.210874 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:16.211521 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:16.218759 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:16.219362 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:16.220380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:16.220825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:16.284916 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:16.293347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-47810a24-4835-4533-8d31-3182199657a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1244 microversion: 2.1 time: 0.086303 Jul 14 11:30:16.293935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 621/1200] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:16 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:17.221717 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:17.222310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:17.232791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:17.233627 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:17.235027 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:17.235806 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:17.254431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=100 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:17.310539 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:17.311068 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:17.317004 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:17.317485 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:17.318258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:17.318699 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:17.381973 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:17.384126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:17.389812 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-97cc8030-0ce6-4cb0-bf7e-fe8ed2b630fc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.172049 Jul 14 11:30:17.391307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 580/1201] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:17 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:17.395215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-9214a10f-7bb7-4cb8-9b3e-824211550c29 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1244 microversion: 2.1 time: 0.086722 Jul 14 11:30:17.395215 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 622/1202] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:17 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:17.952154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-b372ec14-f203-4183-ab20-8424d52dac5a req-49f937ba-b159-47d6-816f-aba824f0b3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30581246-1a52-4bcf-ae18-ca92ecd7366e", "name": "network-vif-plugged", "status": "completed", "tag": "adeb76b3-7b8e-4d92-bddc-fcfc90be61cf"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:17.960533 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-b372ec14-f203-4183-ab20-8424d52dac5a req-49f937ba-b159-47d6-816f-aba824f0b3b3 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:17.960977 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-b372ec14-f203-4183-ab20-8424d52dac5a req-49f937ba-b159-47d6-816f-aba824f0b3b3 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:17.974508 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-b372ec14-f203-4183-ab20-8424d52dac5a req-49f937ba-b159-47d6-816f-aba824f0b3b3 service nova] Creating event network-vif-plugged:adeb76b3-7b8e-4d92-bddc-fcfc90be61cf for instance 30581246-1a52-4bcf-ae18-ca92ecd7366e on hv-cinder-82282 Jul 14 11:30:17.979418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-b372ec14-f203-4183-ab20-8424d52dac5a req-49f937ba-b159-47d6-816f-aba824f0b3b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031352 Jul 14 11:30:17.980811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 581/1203] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:30:18.408491 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:18.409084 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:18.411912 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:18.412614 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:18.415960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:18.416417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:18.417199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:18.417637 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:18.419168 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:18.419626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:18.420402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:18.420844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:18.495712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:18.504013 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e4f68b83-f65a-4b3e-985a-718195feb4bf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1236 microversion: 2.1 time: 0.097724 Jul 14 11:30:18.505225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 582/1204] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:18 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:18.570408 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:18.581307 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-89f9a9b2-817f-478a-b989-7cab8100558d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.176651 Jul 14 11:30:18.581888 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 623/1205] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:18 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:19.531773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:19.532498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:19.535189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:19.540289 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:19.540731 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:19.541514 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:19.542098 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:19.599617 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:19.600123 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:19.608541 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:19.609066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:19.610148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:19.610685 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:19.615347 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=97 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:19.625349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:19.632190 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8064c4bd-4d5c-413a-9512-8205fdf08456 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1292 microversion: 2.1 time: 0.104338 Jul 14 11:30:19.633294 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 583/1206] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:19 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:19.777028 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:19.787495 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-fa353797-1e60-481c-8f1d-94d5843204e0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.191820 Jul 14 11:30:19.792063 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 624/1207] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:19 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:20.650584 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:20.651353 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:20.659401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:20.659853 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:20.660652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:20.661086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:20.728484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:20.736609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-eb301c37-f542-4657-99a8-6f3898247a0c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1300 microversion: 2.1 time: 0.090018 Jul 14 11:30:20.737301 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 584/1208] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:20 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:20.809751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:20.810446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:20.818153 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:20.818675 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:20.819584 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:20.820077 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:20.965721 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:20.974360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-24b38814-4e66-4b0b-a7ec-ca34fafe475a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.170082 Jul 14 11:30:20.975021 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 625/1209] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:20 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:21.754042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:21.754740 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:21.761911 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:21.762359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:21.763169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:21.763609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:21.833517 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:21.841586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d0b2da68-0268-4d56-8b04-3c13084ca765 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1300 microversion: 2.1 time: 0.091452 Jul 14 11:30:21.842183 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 585/1210] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:21 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:21.991662 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:21.992285 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:22.000551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:22.001000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:22.001959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:22.002612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:22.144491 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:22.152771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8c2287d3-6da2-4bcd-a828-c98cc1fec4fa tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.164911 Jul 14 11:30:22.153352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 626/1211] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:21 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:22.858872 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:22.859588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:22.867264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:22.867775 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:22.868868 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:22.869363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:22.939799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:22.947524 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-af691f47-71d3-4054-bfed-8df8354cb9f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1300 microversion: 2.1 time: 0.093344 Jul 14 11:30:22.948115 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 586/1212] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:22 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:23.170882 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:23.172070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:23.180076 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:23.180537 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:23.181455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:23.182072 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:23.329297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:23.337151 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-a2d6fb00-a190-46d1-94e8-893d012669f1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.171512 Jul 14 11:30:23.337866 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 627/1213] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:23 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:23.964822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:23.965494 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:23.972757 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:23.973323 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:23.974157 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:23.974647 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:24.042748 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:24.051573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a81592f9-c860-4240-999c-84c08f348c0b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1300 microversion: 2.1 time: 0.091092 Jul 14 11:30:24.052241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 587/1214] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:23 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:24.357048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:24.357575 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:24.359397 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:24.360131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=12 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:24.365503 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:24.365947 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:24.372432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:24.372432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:24.505803 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:24.513826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-58aaec76-12e0-4b36-aa92-85f5777a91bf tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1267 microversion: 2.1 time: 0.161789 Jul 14 11:30:24.514386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 628/1215] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:24 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:25.072802 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:25.074460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:25.084079 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:25.084594 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:25.085477 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:25.085919 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:25.164181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:25.171974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-9ceeb708-615a-4000-ac40-57859e08f152 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1300 microversion: 2.1 time: 0.104111 Jul 14 11:30:25.172561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 588/1216] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:25 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:25.531786 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:25.532639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:25.539301 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:25.539754 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:25.540738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:25.541188 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:25.784708 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:25.794443 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4fbda5e6-df0a-4d9e-b0b0-61890acdbbfb tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1454 microversion: 2.1 time: 0.266450 Jul 14 11:30:25.795080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 629/1217] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:25 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1454 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:25.814221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:25.814755 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:25.822128 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:25.822921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:25.824879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:25.825680 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:25.990500 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:26.002970 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c7dc08ee-ec88-4012-86dd-e8ff74f40af8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1454 microversion: 2.1 time: 0.192676 Jul 14 11:30:26.003599 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 589/1218] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:25 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1454 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:26.199218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:26.210511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:26.223939 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:26.228022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:26.228022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:26.228022 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:26.550202 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:26.563171 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c31bfbac-60fd-4ffc-b47a-6b747dbe5a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.374146 Jul 14 11:30:26.564198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 630/1219] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:26 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:27.581857 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:27.582528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:27.592816 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:27.594831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:27.596048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:27.596921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:27.758917 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-f26ac3a9-23c8-4968-a86c-b21a90589dba req-9c8e6f54-a806-4b4a-9b02-df2d725f04b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8742a56-7758-4ebf-80ce-b4e20892dac9", "tag": "bf46b8e0-01f6-4c48-90e0-0a496dcebf84"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:27.774531 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-f26ac3a9-23c8-4968-a86c-b21a90589dba req-9c8e6f54-a806-4b4a-9b02-df2d725f04b2 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:27.774984 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-f26ac3a9-23c8-4968-a86c-b21a90589dba req-9c8e6f54-a806-4b4a-9b02-df2d725f04b2 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:27.789711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:27.801425 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4301ff0a-645a-4cc5-905a-ef5a079950fa tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.221985 Jul 14 11:30:27.803425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-f26ac3a9-23c8-4968-a86c-b21a90589dba req-9c8e6f54-a806-4b4a-9b02-df2d725f04b2 service nova] Creating event network-changed:bf46b8e0-01f6-4c48-90e0-0a496dcebf84 for instance b8742a56-7758-4ebf-80ce-b4e20892dac9 on hv-cinder-82282 Jul 14 11:30:27.805530 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 590/1220] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:27 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:27.811821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-f26ac3a9-23c8-4968-a86c-b21a90589dba req-9c8e6f54-a806-4b4a-9b02-df2d725f04b2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059796 Jul 14 11:30:27.812777 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 631/1221] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:30:28.819609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:28.820225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:28.831039 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:28.831588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:28.832446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:28.833161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:29.006327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:29.023235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-26c916a9-dc9d-4ce8-b176-08858b689eb9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.207491 Jul 14 11:30:29.024259 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 591/1222] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:28 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:29.834631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-13ac0fa3-0466-4952-8c97-96e7fb719f34 req-6b6cb079-dec3-4d4d-8602-f0f77c24e2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30581246-1a52-4bcf-ae18-ca92ecd7366e", "tag": "adeb76b3-7b8e-4d92-bddc-fcfc90be61cf"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:29.840647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:29.850098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-13ac0fa3-0466-4952-8c97-96e7fb719f34 req-6b6cb079-dec3-4d4d-8602-f0f77c24e2ee service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:29.851867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-13ac0fa3-0466-4952-8c97-96e7fb719f34 req-6b6cb079-dec3-4d4d-8602-f0f77c24e2ee service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:29.869133 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-13ac0fa3-0466-4952-8c97-96e7fb719f34 req-6b6cb079-dec3-4d4d-8602-f0f77c24e2ee service nova] Creating event network-changed:adeb76b3-7b8e-4d92-bddc-fcfc90be61cf for instance 30581246-1a52-4bcf-ae18-ca92ecd7366e on hv-cinder-82282 Jul 14 11:30:29.875208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-13ac0fa3-0466-4952-8c97-96e7fb719f34 req-6b6cb079-dec3-4d4d-8602-f0f77c24e2ee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044761 Jul 14 11:30:29.876339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 632/1223] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:30:30.051352 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:30.053332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:30.065661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:30.066134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:30.066969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:30.067448 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:30.277260 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:30.290670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d923fe63-3450-436a-ad7c-6852cc878236 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.251613 Jul 14 11:30:30.295626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 592/1224] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:30 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:31.316897 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:31.318214 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:31.329031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:31.329519 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:31.333379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:31.333379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:31.478627 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:31.488715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e435cfe9-77d9-48bf-be54-526ee7b60e96 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.183064 Jul 14 11:30:31.489455 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 633/1225] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:31 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:32.507052 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:32.507984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:32.515619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:32.516377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:32.517277 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:32.517810 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:32.748010 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:32.762333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-debc36a9-0303-4879-a691-b31861144229 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.259830 Jul 14 11:30:32.763640 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 593/1226] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:32 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:33.780609 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:33.781578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:33.788530 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:33.788975 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:33.789759 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:33.790187 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:33.967992 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:33.977644 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6e6614c0-5b74-4ac6-9c85-5be0a63cbb0f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.202260 Jul 14 11:30:33.978424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 634/1227] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:33 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:34.011676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-fa6c44bf-71a2-49f1-88a3-ec968f47eda0 req-7e1bd6a1-3796-4a87-9b3a-2b7202f2e7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8742a56-7758-4ebf-80ce-b4e20892dac9", "name": "network-vif-plugged", "status": "completed", "tag": "bf46b8e0-01f6-4c48-90e0-0a496dcebf84"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:34.022471 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-fa6c44bf-71a2-49f1-88a3-ec968f47eda0 req-7e1bd6a1-3796-4a87-9b3a-2b7202f2e7b5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:34.023308 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-fa6c44bf-71a2-49f1-88a3-ec968f47eda0 req-7e1bd6a1-3796-4a87-9b3a-2b7202f2e7b5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:34.037555 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-fa6c44bf-71a2-49f1-88a3-ec968f47eda0 req-7e1bd6a1-3796-4a87-9b3a-2b7202f2e7b5 service nova] Creating event network-vif-plugged:bf46b8e0-01f6-4c48-90e0-0a496dcebf84 for instance b8742a56-7758-4ebf-80ce-b4e20892dac9 on hv-cinder-82282 Jul 14 11:30:34.043457 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-fa6c44bf-71a2-49f1-88a3-ec968f47eda0 req-7e1bd6a1-3796-4a87-9b3a-2b7202f2e7b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038850 Jul 14 11:30:34.044544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 594/1228] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:30:34.995655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:34.996304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:35.009088 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:35.011194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:35.013357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:35.013912 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:35.193369 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:35.204288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-97811405-a2a1-4677-bf45-39c803c68a25 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.213275 Jul 14 11:30:35.205069 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 635/1229] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:34 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:30:36.223606 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:36.225005 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:36.236384 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:36.237479 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:36.240624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:36.241434 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:36.425104 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:36.444792 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a7a65b53-7da2-4b7b-8332-fbcf6c529a61 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1366 microversion: 2.1 time: 0.226015 Jul 14 11:30:36.445823 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 595/1230] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:36 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:37.503094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:37.503737 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:37.512122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:37.512965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:37.514416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:37.515255 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:37.673683 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:30:37.682938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4d1fd2fa-87ec-4630-b4b6-ee3cd6bc7847 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1556 microversion: 2.1 time: 0.185750 Jul 14 11:30:37.682938 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 636/1231] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:30:37 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:30:37.699818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:30:37.701208 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:30:37.707841 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:37.708296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:37.709071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:37.709686 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:37.802014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5442653d-acb5-47ac-959a-59d446f5ef39 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106512 Jul 14 11:30:37.803346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 596/1232] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:30:37 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:30:38.843096 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-6c441018-ea5a-4b28-8a51-8c010c6897d6 req-1091da55-f4ba-4ac6-a03f-ac520f8c120e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8742a56-7758-4ebf-80ce-b4e20892dac9", "tag": "bf46b8e0-01f6-4c48-90e0-0a496dcebf84"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:30:38.852868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-6c441018-ea5a-4b28-8a51-8c010c6897d6 req-1091da55-f4ba-4ac6-a03f-ac520f8c120e service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:30:38.853309 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-6c441018-ea5a-4b28-8a51-8c010c6897d6 req-1091da55-f4ba-4ac6-a03f-ac520f8c120e service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:30:38.873706 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-6c441018-ea5a-4b28-8a51-8c010c6897d6 req-1091da55-f4ba-4ac6-a03f-ac520f8c120e service nova] Creating event network-changed:bf46b8e0-01f6-4c48-90e0-0a496dcebf84 for instance b8742a56-7758-4ebf-80ce-b4e20892dac9 on hv-cinder-82282 Jul 14 11:30:38.881304 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-6c441018-ea5a-4b28-8a51-8c010c6897d6 req-1091da55-f4ba-4ac6-a03f-ac520f8c120e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042467 Jul 14 11:30:38.881929 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 637/1233] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:31:57.162641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=27 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:57.163433 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=89 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:57.167848 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:31:57.168346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:31:57.174523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:31:57.175589 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:31:57.176466 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:31:57.176994 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:31:57.202819 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fad28ff1-93d6-4d1b-949d-8231560fe872 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/ips" status: 200 len: 148 microversion: 2.1 time: 0.042277 Jul 14 11:31:57.203464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 597/1234] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:31:57 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:31:59.162850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=11 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:59.163610 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=71 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:59.168240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b533fe4-a255-4167-af8e-fa1491aba5c4"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:31:59.169383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:31:59.176240 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:31:59.176722 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:31:59.177571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:31:59.177958 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:00.007671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f8a6184a-a93e-4ec0-b1a1-d3aa8e77b874 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846186 Jul 14 11:32:00.008566 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 638/1235] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:31:59 2022] POST /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:32:08.562020 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-35a79850-f4f6-4e87-9ff6-8c112a443ae8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: .version_select at 0x7f3416bf6700>, body: {"keypair": {"name": "tempest-keypair-2013352123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB44SlA5jj7UcY8psi6G69oBvZ2DvXal+sgDqq8FCMMZtBhXRUiC/crxfTWuA3yrwcKdlNApbvYXQ5NV6YvHH2yXVBDm/8YtL+c2slNQ5i0FINUbtx2F7sJIaHIq08PhXQ=="}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:08.577485 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-35a79850-f4f6-4e87-9ff6-8c112a443ae8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:32:08.581437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-35a79850-f4f6-4e87-9ff6-8c112a443ae8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:32:08.659962 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-35a79850-f4f6-4e87-9ff6-8c112a443ae8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102517 Jul 14 11:32:08.660490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 598/1236] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:32:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:32:11.082509 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:11.083380 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:11.087948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310817879", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d0793d7-484a-4624-89ee-2256db3098b1"}], "security_groups": [{"name": "tempest-securitygroup--1610158167"}], "key_name": "tempest-keypair-2013352123", "user_data": "}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:11.349865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] validate_networks() for [('7d0793d7-484a-4624-89ee-2256db3098b1', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:32:11.721766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:32:11.722274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:32:11.722951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:32:11.723402 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:32:11.723825 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:32:11.733383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:11.733839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:11.734638 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:11.735079 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:11.751772 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:32:11.755726 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:32:11.766768 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:32:11.769142 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:32:11.889615 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ee840d96-0f46-4de6-a818-1476e0b7d4d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.808347 Jul 14 11:32:11.890352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 639/1237] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:32:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:32:11.901166 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-12860f85-00a1-4971-8860-0e23ad572e5b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:11.901785 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-12860f85-00a1-4971-8860-0e23ad572e5b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:12.059977 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-12860f85-00a1-4971-8860-0e23ad572e5b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:12.066497 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-12860f85-00a1-4971-8860-0e23ad572e5b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1241 microversion: 2.1 time: 0.170293 Jul 14 11:32:12.075664 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 599/1238] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:11 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:32:13.090417 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:13.091034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:13.098589 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:13.099040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:13.099900 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:13.100360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:13.161520 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:13.169760 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-194357fa-c629-4147-bed8-e6a59665fdad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1237 microversion: 2.1 time: 0.083872 Jul 14 11:32:13.170319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 640/1239] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:13 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:13.943816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:32:13.944083 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:32:14.188705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:14.189945 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:14.206836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:14.207339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:14.208425 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:14.209254 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:14.281688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:14.290146 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-290bbd83-6ff4-4ce8-80a5-d9bab34e3cd8 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1299 microversion: 2.1 time: 0.105155 Jul 14 11:32:14.290734 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 600/1240] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:14 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:32:15.319552 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:15.320173 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:15.327720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:15.328172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:15.328965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:15.329403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:15.520137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:15.527763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f09bb25d-cd75-40b1-8ee0-836b1dcc8553 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.212202 Jul 14 11:32:15.528320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 641/1241] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:15 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:15.615186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-2b786528-6bbe-4128-87d5-5f54284bb83a req-ec657f8c-27a6-4832-b2c2-c85c45d1deee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3", "tag": "b4294e6f-e79c-4534-b837-7158014b48f2"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:15.632487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-2b786528-6bbe-4128-87d5-5f54284bb83a req-ec657f8c-27a6-4832-b2c2-c85c45d1deee service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:15.632487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-2b786528-6bbe-4128-87d5-5f54284bb83a req-ec657f8c-27a6-4832-b2c2-c85c45d1deee service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:15.642573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-2b786528-6bbe-4128-87d5-5f54284bb83a req-ec657f8c-27a6-4832-b2c2-c85c45d1deee service nova] Creating event network-changed:b4294e6f-e79c-4534-b837-7158014b48f2 for instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 on hv-cinder-82282 Jul 14 11:32:15.648375 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-2b786528-6bbe-4128-87d5-5f54284bb83a req-ec657f8c-27a6-4832-b2c2-c85c45d1deee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042051 Jul 14 11:32:15.649017 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 601/1242] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:32:16.545501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:16.546743 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:16.553371 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:16.553837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:16.554624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:16.555690 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:16.762107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:16.769584 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-71dd2ed2-9ca3-4f96-a6bf-491a7f937447 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.228032 Jul 14 11:32:16.770162 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 642/1243] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:16 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:17.788516 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:17.789773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:17.796424 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:17.796878 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:17.797659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:17.798102 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:17.938386 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:17.946619 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8071f8c8-41dc-49b0-84fd-9e2d574a050a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.163182 Jul 14 11:32:17.947209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 602/1244] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:17 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:18.964348 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:18.964967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:18.971339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:18.971791 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:18.972557 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:18.972993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:19.103729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:19.111080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d7d6951e-ee08-4957-9750-25742662d368 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.151428 Jul 14 11:32:19.111732 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 643/1245] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:18 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:20.128160 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:20.128774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:20.136327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:20.136779 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:20.137552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:20.137987 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:20.274757 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:20.282440 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e4379865-0751-4fe3-86a3-8a40321b6aad tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.158236 Jul 14 11:32:20.283009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 603/1246] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:20 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:32:21.300352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:21.300960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:21.307555 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:21.307971 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:21.308741 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:21.309174 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:21.447675 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:21.452842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f1b00f43-dc72-4ae5-9224-73772b07d69b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.156284 Jul 14 11:32:21.453410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 644/1247] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:21 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:22.413398 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-9f759091-794a-4e9c-9bca-b1e94f8b3d3e req-d794fef0-73cd-45fd-b40f-83f006c31e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3", "name": "network-vif-plugged", "status": "completed", "tag": "b4294e6f-e79c-4534-b837-7158014b48f2"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:22.418170 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:22.423664 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-9f759091-794a-4e9c-9bca-b1e94f8b3d3e req-d794fef0-73cd-45fd-b40f-83f006c31e40 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:22.424150 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-9f759091-794a-4e9c-9bca-b1e94f8b3d3e req-d794fef0-73cd-45fd-b40f-83f006c31e40 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:22.436355 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-9f759091-794a-4e9c-9bca-b1e94f8b3d3e req-d794fef0-73cd-45fd-b40f-83f006c31e40 service nova] Creating event network-vif-plugged:b4294e6f-e79c-4534-b837-7158014b48f2 for instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 on hv-cinder-82282 Jul 14 11:32:22.441641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-9f759091-794a-4e9c-9bca-b1e94f8b3d3e req-d794fef0-73cd-45fd-b40f-83f006c31e40 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Jul 14 11:32:22.442254 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 604/1248] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:32:22.470230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:22.470828 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:22.472718 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:22.473409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=6 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:22.480428 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:22.480880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:22.481671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:22.482117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:22.616919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:22.625935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ec5c056c-a549-4d7b-8bcb-0881c976ded7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.159517 Jul 14 11:32:22.626846 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 645/1249] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:22 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:23.644702 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:23.645400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:23.651784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:23.657319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:23.657319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:23.657319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:23.795482 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:23.802959 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-43824747-316a-499a-9027-14a8ffa6fd65 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1367 microversion: 2.1 time: 0.163271 Jul 14 11:32:23.803552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 605/1250] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:23 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:24.821333 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:24.821923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:24.828629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:24.829075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:24.829842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:24.830280 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:24.961716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:24.969258 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1702e716-c1c2-4c29-8743-b2fda117c1a0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1556 microversion: 2.1 time: 0.152470 Jul 14 11:32:24.969821 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 646/1251] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:24 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:24.985557 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:24.986074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:24.992921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:24.993374 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:24.994154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:24.994600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:25.072926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f6c72df8-9de3-4752-87ef-7e4edcc8565d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091089 Jul 14 11:32:25.073461 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 606/1252] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:32:24 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:32:26.061329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-2b28de15-e5e0-47fc-ac29-7d47cc2a6159 req-72fbf0e1-5039-418e-a51f-75d745a9e3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3", "tag": "b4294e6f-e79c-4534-b837-7158014b48f2"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:26.070641 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-2b28de15-e5e0-47fc-ac29-7d47cc2a6159 req-72fbf0e1-5039-418e-a51f-75d745a9e3f5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:26.071090 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-2b28de15-e5e0-47fc-ac29-7d47cc2a6159 req-72fbf0e1-5039-418e-a51f-75d745a9e3f5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:26.082080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-2b28de15-e5e0-47fc-ac29-7d47cc2a6159 req-72fbf0e1-5039-418e-a51f-75d745a9e3f5 service nova] Creating event network-changed:b4294e6f-e79c-4534-b837-7158014b48f2 for instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 on hv-cinder-82282 Jul 14 11:32:26.087551 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-2b28de15-e5e0-47fc-ac29-7d47cc2a6159 req-72fbf0e1-5039-418e-a51f-75d745a9e3f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029782 Jul 14 11:32:26.088147 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 647/1253] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:32:45.224960 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:45.225799 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=36 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:45.230620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1572372837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1262803912", "security_groups": [{"name": "tempest-secgroup-smoke-1603179061"}], "block_device_mapping_v2": [{"uuid": "8b1c70ea-e119-4579-815a-ca6e77e28ec1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dcd81d06-0465-420e-871c-9fad1baf38d1"}]}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:45.342178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] validate_networks() for [('dcd81d06-0465-420e-871c-9fad1baf38d1', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:32:45.711846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:32:45.712831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:32:45.713410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:32:45.713828 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:32:45.714243 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:32:45.723218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:45.723675 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:45.724487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:45.724933 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:45.741961 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for project f3904fb55e2e463fb548333d97601ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:32:45.746182 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Getting quotas for user c466157931bd41baabb01abbec492b4f and project f3904fb55e2e463fb548333d97601ce5. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:32:45.804349 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:32:45.809634 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b1c70ea-e119-4579-815a-ca6e77e28ec1',volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:32:46.179587 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2b2cb701-49d1-4a3e-b96d-294386852fcd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.956012 Jul 14 11:32:46.180361 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 607/1254] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:32:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:32:46.189055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:46.189867 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=46 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:46.194015 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6cedd001-8330-4d1d-8fd6-2baf132dede5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:46.194715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6cedd001-8330-4d1d-8fd6-2baf132dede5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:46.254833 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6cedd001-8330-4d1d-8fd6-2baf132dede5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:46.262405 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6cedd001-8330-4d1d-8fd6-2baf132dede5 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1095 microversion: 2.1 time: 0.074986 Jul 14 11:32:46.262953 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 648/1255] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:46 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:47.278859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:47.279495 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:47.286971 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:47.287456 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:47.288242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:47.288690 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:47.354529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:47.370831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c13f9d5a-49ff-4e29-a147-97b389327c4d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1137 microversion: 2.1 time: 0.087461 Jul 14 11:32:47.370831 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 608/1256] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:47 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:48.380797 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:48.381586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:48.391814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:48.391814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:48.394734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:48.394734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:48.471264 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:48.479507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6aaa78d7-d154-43cf-8561-e571a4ca8d4e tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1211 microversion: 2.1 time: 0.102521 Jul 14 11:32:48.480312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 649/1257] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:48 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:49.497037 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:49.497759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:49.504432 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:49.504883 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:49.505668 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:49.506108 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:49.657363 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:49.669222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-02d9a786-ac24-455b-9742-21431eb01b45 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1279 microversion: 2.1 time: 0.176046 Jul 14 11:32:49.670249 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 609/1258] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:49 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:49.922233 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-34de61ef-e223-4cae-850f-a71d8b5d8da1 req-d1ae8a63-6dfe-449a-9288-0704cf2cd019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d8639b-5827-4f1f-b5d8-12ad5b40214d", "tag": "b22e93ca-1ce7-461b-916b-f2aa4b4fc42b"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:32:49.945864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-34de61ef-e223-4cae-850f-a71d8b5d8da1 req-d1ae8a63-6dfe-449a-9288-0704cf2cd019 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:49.946607 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-34de61ef-e223-4cae-850f-a71d8b5d8da1 req-d1ae8a63-6dfe-449a-9288-0704cf2cd019 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:49.962496 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-34de61ef-e223-4cae-850f-a71d8b5d8da1 req-d1ae8a63-6dfe-449a-9288-0704cf2cd019 service nova] Creating event network-changed:b22e93ca-1ce7-461b-916b-f2aa4b4fc42b for instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d on hv-cinder-82282 Jul 14 11:32:49.968802 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-34de61ef-e223-4cae-850f-a71d8b5d8da1 req-d1ae8a63-6dfe-449a-9288-0704cf2cd019 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055400 Jul 14 11:32:49.970007 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 650/1259] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:32:50.686527 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:50.687172 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:50.693900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:50.694366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:50.695181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:50.695629 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:50.832113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:50.840262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1907c1fc-41b7-4da1-9bac-de9f51f0b1d6 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.157726 Jul 14 11:32:50.841113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 610/1260] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:50 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:51.858393 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:51.859141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:51.866401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:51.866869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:51.867668 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:51.868095 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:52.006948 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:52.015806 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d36cdfee-cd7d-4fee-bd3a-26296e501a47 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.161962 Jul 14 11:32:52.016383 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 651/1261] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:51 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:53.033935 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:53.034547 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:53.041142 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:53.041594 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:53.043038 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:53.043921 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:53.187153 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:53.194746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b8dee030-bc95-4cec-bcc6-0fb91c40a23f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.164726 Jul 14 11:32:53.195332 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 611/1262] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:53 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:54.212453 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:54.213067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:54.220080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:54.220533 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:54.221329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:54.221773 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:54.356130 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:54.364789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-f4832b02-c82b-4d45-b25c-28d37242c287 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.156183 Jul 14 11:32:54.365349 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 652/1263] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:54 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:55.382207 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:55.382795 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:55.389941 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:55.390391 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:55.391186 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:55.391622 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:55.522502 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:55.531199 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8c82442b-8d88-415b-97cf-4eaee16abbf3 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.152867 Jul 14 11:32:55.531761 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 612/1264] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:55 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:56.549511 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:56.550149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:56.552771 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:56.557673 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:56.558116 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:56.558910 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:56.559356 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:56.694389 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:56.702416 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7cb8b6d2-a45b-43f0-ad39-aa2fee026619 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.157351 Jul 14 11:32:56.703003 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 653/1265] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:56 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:57.720012 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:57.720691 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:57.722509 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:57.723244 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:57.728569 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:57.729022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:57.729794 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:57.730270 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:57.865938 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:57.874009 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-80162d70-eaf7-46f8-b2dd-cf5cd02f3326 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.157831 Jul 14 11:32:57.874595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 613/1266] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:57 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:32:58.891445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:32:58.892091 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:32:58.898647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:58.899091 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:58.899892 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:32:58.900323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:32:59.038762 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:32:59.048235 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2893f986-a68e-4fab-a7d2-ab2a6f62d3dd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.161331 Jul 14 11:32:59.048824 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 654/1267] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:32:58 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:00.065410 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:00.066060 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:00.072578 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:00.073042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:00.074469 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:00.074923 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:00.212193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:00.220081 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e416790d-edd4-4aec-90a8-927d82bd4845 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.158870 Jul 14 11:33:00.220682 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 614/1268] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:00 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:01.237297 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:01.237918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:01.244312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:01.244764 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:01.245536 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:01.246127 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:01.389042 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:01.396829 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-08b090be-4712-4e4b-b5ba-fcc3c4175efd tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.163472 Jul 14 11:33:01.397410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 655/1269] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:01 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:02.414134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:02.414687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:02.422006 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:02.422489 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:02.423287 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:02.423732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:02.557470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:02.565134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-547db7d1-b314-4fa4-9e9d-9fc47f962dcc tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.155029 Jul 14 11:33:02.565764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 615/1270] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:02 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:02.694372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-f8162d00-4c57-460c-b745-dffb9850ced2 req-e7e41b56-7a85-46f5-931b-95643d9f489e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d8639b-5827-4f1f-b5d8-12ad5b40214d", "name": "network-vif-plugged", "status": "completed", "tag": "b22e93ca-1ce7-461b-916b-f2aa4b4fc42b"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:33:02.704051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-f8162d00-4c57-460c-b745-dffb9850ced2 req-e7e41b56-7a85-46f5-931b-95643d9f489e service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:02.704505 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-f8162d00-4c57-460c-b745-dffb9850ced2 req-e7e41b56-7a85-46f5-931b-95643d9f489e service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:02.716033 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-f8162d00-4c57-460c-b745-dffb9850ced2 req-e7e41b56-7a85-46f5-931b-95643d9f489e service nova] Creating event network-vif-plugged:b22e93ca-1ce7-461b-916b-f2aa4b4fc42b for instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d on hv-cinder-82282 Jul 14 11:33:02.721168 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-f8162d00-4c57-460c-b745-dffb9850ced2 req-e7e41b56-7a85-46f5-931b-95643d9f489e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Jul 14 11:33:02.721788 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 656/1271] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:33:03.583419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:03.584042 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:03.590548 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:03.590998 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:03.591989 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:03.592429 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:03.729980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:03.738749 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e40b3667-c160-45d2-88cd-74d34c0daa00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.158950 Jul 14 11:33:03.739377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 616/1272] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:03 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:04.757502 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:04.758226 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:04.765200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:04.765976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:04.766692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:04.767158 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:04.910693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:04.919286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0aa24da1-1efb-42d9-af15-5107458dc2b2 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1267 microversion: 2.1 time: 0.166631 Jul 14 11:33:04.920012 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 657/1273] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:04 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:05.938817 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:05.939460 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:05.945975 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:05.946418 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:05.947202 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:05.947636 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:06.088784 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:06.097330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f6756e01-38df-4cfa-969a-3356fad784d0 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1455 microversion: 2.1 time: 0.162357 Jul 14 11:33:06.097947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 617/1274] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:05 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:06.114098 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:06.114758 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:06.121272 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:06.121746 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:06.122486 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:06.122923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:06.263724 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:06.272470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-8c0658dd-19ca-4f74-bdfe-0262ff877d7f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1455 microversion: 2.1 time: 0.162459 Jul 14 11:33:06.273025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 658/1275] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:06 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:08.585680 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-9abd64d7-bbee-4015-a2fc-f7b33b25cd04 req-98a45ed6-f248-4550-80a8-567580c1a0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d8639b-5827-4f1f-b5d8-12ad5b40214d", "tag": "b22e93ca-1ce7-461b-916b-f2aa4b4fc42b"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:33:08.594700 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-9abd64d7-bbee-4015-a2fc-f7b33b25cd04 req-98a45ed6-f248-4550-80a8-567580c1a0c7 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:08.595181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-9abd64d7-bbee-4015-a2fc-f7b33b25cd04 req-98a45ed6-f248-4550-80a8-567580c1a0c7 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:08.606537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-9abd64d7-bbee-4015-a2fc-f7b33b25cd04 req-98a45ed6-f248-4550-80a8-567580c1a0c7 service nova] Creating event network-changed:b22e93ca-1ce7-461b-916b-f2aa4b4fc42b for instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d on hv-cinder-82282 Jul 14 11:33:08.612341 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-9abd64d7-bbee-4015-a2fc-f7b33b25cd04 req-98a45ed6-f248-4550-80a8-567580c1a0c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030201 Jul 14 11:33:08.613191 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 618/1276] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:33:44.261100 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:44.261702 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:44.263720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=24 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:44.264379 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=52 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:44.269943 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.270389 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.271190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.271630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.294811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-75421a6d-bfb7-4991-a41b-2ebd66515ec3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/ips" status: 200 len: 148 microversion: 2.1 time: 0.037687 Jul 14 11:33:44.295492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 659/1277] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:33:44 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:33:44.304647 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:44.305425 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=64 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:44.309814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b533fe4-a255-4167-af8e-fa1491aba5c4"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:33:44.311025 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:44.317898 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.318346 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.319154 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.319588 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.401442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Invalid volume: volume 3b533fe4-a255-4167-af8e-fa1491aba5c4 is already attached to instances: b8742a56-7758-4ebf-80ce-b4e20892dac9 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: POST /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/os-volume_attachments HTTP/1.1 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 74 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:33:44.403470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {"volumeAttachment": {"volumeId": "3b533fe4-a255-4167-af8e-fa1491aba5c4"}} Jul 14 11:33:44.405275 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Invalid volume: volume 3b533fe4-a255-4167-af8e-fa1491aba5c4 is already attached to instances: b8742a56-7758-4ebf-80ce-b4e20892dac9 Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'server_id': '1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3', 'body': {'volumeAttachment': {'volumeId': '3b533fe4-a255-4167-af8e-fa1491aba5c4'}}} Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b533fe4-a255-4167-af8e-fa1491aba5c4 is already attached to instances: b8742a56-7758-4ebf-80ce-b4e20892dac9 Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:33:44.406300 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b533fe4-a255-4167-af8e-fa1491aba5c4 is already attached to instances: b8742a56-7758-4ebf-80ce-b4e20892dac9 Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:44.407891 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b533fe4-a255-4167-af8e-fa1491aba5c4 is already attached to instances: b8742a56-7758-4ebf-80ce-b4e20892dac9 Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 400 to user: Invalid volume: volume 3b533fe4-a255-4167-af8e-fa1491aba5c4 is already attached to instances: b8742a56-7758-4ebf-80ce-b4e20892dac9 {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6aa64811-546d-4ef6-ac01-cdeaf24fbe52 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102317 Jul 14 11:33:44.409549 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 619/1278] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:33:44 2022] POST /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:33:44.413812 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:44.414319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:44.421477 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.421925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.422884 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.423342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.448482 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:33:44.781476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-253b658f-12f0-4496-9cc7-50db8206eb98 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 204 len: 0 microversion: 2.1 time: 0.371196 Jul 14 11:33:44.782208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 660/1279] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:33:44 2022] DELETE /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:33:44.790631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:44.791278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:44.798286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.798746 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.799575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:44.800047 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:44.949446 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:44.957274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-62ad63d0-5e50-47a7-9018-a2ab5e1fc921 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1680 microversion: 2.1 time: 0.170794 Jul 14 11:33:44.957847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 620/1280] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:44 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:45.975376 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:45.976090 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:45.982868 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:45.983360 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:45.984141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:45.985287 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:46.121386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:46.129016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0197eb40-3db8-4acb-9d11-e1e811c5ac56 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1680 microversion: 2.1 time: 0.157887 Jul 14 11:33:46.129727 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 661/1281] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:45 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:47.148206 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:47.148803 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:47.155511 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:47.155967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:47.156760 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:47.157204 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:47.292087 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:47.305470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-1497772b-3f2b-4010-ad22-4f67543be8a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1680 microversion: 2.1 time: 0.160890 Jul 14 11:33:47.312620 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 621/1282] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:47 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:47.624862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-67632bd3-a18d-44d5-a07c-5cc640b6426a req-0fea1059-4b01-4749-8892-a23597a1128b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3", "name": "network-vif-deleted", "tag": "b4294e6f-e79c-4534-b837-7158014b48f2"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:33:47.637484 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-67632bd3-a18d-44d5-a07c-5cc640b6426a req-0fea1059-4b01-4749-8892-a23597a1128b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:47.637931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-67632bd3-a18d-44d5-a07c-5cc640b6426a req-0fea1059-4b01-4749-8892-a23597a1128b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:47.649398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-67632bd3-a18d-44d5-a07c-5cc640b6426a req-0fea1059-4b01-4749-8892-a23597a1128b service nova] Creating event network-vif-deleted:b4294e6f-e79c-4534-b837-7158014b48f2 for instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 on hv-cinder-82282 Jul 14 11:33:47.654736 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-67632bd3-a18d-44d5-a07c-5cc640b6426a req-0fea1059-4b01-4749-8892-a23597a1128b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Jul 14 11:33:47.656471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 662/1283] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:33:48.323453 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:48.324705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:48.331626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:48.332084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:48.332870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:48.333306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:48.367011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:48.367684 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:48.368144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'fault' on Instance uuid 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:33:48.411105 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:48.418811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ada666c9-3982-4952-afe4-fe9a81ec4f9d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 200 len: 1331 microversion: 2.1 time: 0.099426 Jul 14 11:33:48.419652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 622/1284] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:48 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:49.438249 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:49.438891 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:49.445131 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:49.445581 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:49.446344 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:49.446782 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:49.459851 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 HTTP/1.1 Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:33:49.461476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:33:49.463181 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3'} Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:33:49.464126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:33:49.465789 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:49.467586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:33:49.467586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d2a2484b-869f-4933-8973-52953fb203ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 404 len: 111 microversion: 2.1 time: 0.030188 Jul 14 11:33:49.467586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 663/1285] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:49 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:33:49.472378 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-62ba8dfa-c68d-4da0-920c-a27e6886cff7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '.version_select at 0x7f3412d6b670>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:49.553296 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-62ba8dfa-c68d-4da0-920c-a27e6886cff7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013352123" status: 202 len: 0 microversion: 2.1 time: 0.085136 Jul 14 11:33:49.553876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 623/1286] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jul 14 11:33:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2013352123 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:33:50.323187 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:50.324293 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:50.329781 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:50.330259 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:50.331035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:50.331521 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:50.412164 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'services' on Instance uuid b8742a56-7758-4ebf-80ce-b4e20892dac9 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:33:50.581156 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-b2d23cf2-eb2b-47cb-9530-b708524ae87a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments/3b533fe4-a255-4167-af8e-fa1491aba5c4" status: 202 len: 0 microversion: 2.1 time: 0.261722 Jul 14 11:33:50.581773 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 664/1287] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:33:50 2022] DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments/3b533fe4-a255-4167-af8e-fa1491aba5c4 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:33:50.590712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:50.591769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:50.599350 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:50.599809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:50.600595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:50.601100 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:50.631330 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-500450b8-9c1f-4a56-8ba7-ee7d6f5a94d7 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Jul 14 11:33:50.631897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 624/1288] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:33:50 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:33:51.643744 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:51.644808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:51.652392 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:51.652847 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:51.653634 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:51.654075 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:51.684207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ee097a91-89b4-4f66-ae5d-1a7025dce76f tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045514 Jul 14 11:33:51.684826 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 665/1289] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:33:51 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:33:52.696859 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:52.697786 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:52.704980 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:52.705430 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:52.706205 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:52.706644 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:52.737021 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a20d02ee-e4cb-483f-a149-866def8d8614 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044100 Jul 14 11:33:52.737572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 625/1290] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:33:52 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:33:52.793783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:52.794397 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:52.801035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:52.801480 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:52.802241 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:52.802674 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:52.830079 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:33:53.129314 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c1ae18a3-6f8c-4489-b005-6d3018aea955 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 204 len: 0 microversion: 2.1 time: 0.339170 Jul 14 11:33:53.129928 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 666/1291] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:33:52 2022] DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:33:53.140565 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:53.141189 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:53.147419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:53.147870 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:53.148654 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:53.149095 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:53.287687 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:53.295268 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3228c730-a6c5-40c3-a469-5afbc5c15128 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1679 microversion: 2.1 time: 0.160679 Jul 14 11:33:53.295839 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 626/1292] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:53 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:33:54.314698 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:54.315425 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:54.322216 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:54.322663 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:54.323472 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:54.323908 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:54.464421 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:54.471842 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-167b51c7-76ed-47ff-b9d1-be5296155c10 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1679 microversion: 2.1 time: 0.162087 Jul 14 11:33:54.472398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 667/1293] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:54 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:55.489876 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:55.490490 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:55.497126 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:55.497575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:55.498354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:55.498791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:55.635192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:55.644015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-31fd00ba-034c-426b-b1ef-82b3b82fce81 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1679 microversion: 2.1 time: 0.158195 Jul 14 11:33:55.644595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 627/1294] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:55 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:56.309561 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-350549b3-9deb-47e8-8bbb-652ea1dfe915 req-2e099ddb-4029-4cf7-9993-74a56c5aeff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8742a56-7758-4ebf-80ce-b4e20892dac9", "name": "network-vif-deleted", "tag": "bf46b8e0-01f6-4c48-90e0-0a496dcebf84"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:33:56.317303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-350549b3-9deb-47e8-8bbb-652ea1dfe915 req-2e099ddb-4029-4cf7-9993-74a56c5aeff9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:56.317748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-350549b3-9deb-47e8-8bbb-652ea1dfe915 req-2e099ddb-4029-4cf7-9993-74a56c5aeff9 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:56.332956 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-350549b3-9deb-47e8-8bbb-652ea1dfe915 req-2e099ddb-4029-4cf7-9993-74a56c5aeff9 service nova] Creating event network-vif-deleted:bf46b8e0-01f6-4c48-90e0-0a496dcebf84 for instance b8742a56-7758-4ebf-80ce-b4e20892dac9 on hv-cinder-82282 Jul 14 11:33:56.340217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-350549b3-9deb-47e8-8bbb-652ea1dfe915 req-2e099ddb-4029-4cf7-9993-74a56c5aeff9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106079 Jul 14 11:33:56.340935 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 668/1295] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:33:56.661222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:56.661864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:56.668339 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:56.668793 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:56.669631 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:56.670071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:56.703917 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:56.704377 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:56.704846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'fault' on Instance uuid b8742a56-7758-4ebf-80ce-b4e20892dac9 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:33:56.756107 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:33:56.767188 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d540a54f-8c0b-4608-a2bb-a99c17eb5804 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 200 len: 1330 microversion: 2.1 time: 0.110175 Jul 14 11:33:56.767793 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 628/1296] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:56 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:33:57.786013 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:57.786740 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:33:57.793099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:57.793545 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:57.794319 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:33:57.794751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:33:57.809358 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 HTTP/1.1 Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:33:57.812298 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:33:57.814048 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'b8742a56-7758-4ebf-80ce-b4e20892dac9'} Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:33:57.815017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:33:57.816592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:33:57.818034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:33:57.818034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-3b4898fb-8957-4108-a883-c252e715a484 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 404 len: 111 microversion: 2.1 time: 0.031960 Jul 14 11:33:57.818034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 669/1297] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:33:57 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:33:57.821795 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2bcd167a-d3c8-4483-9f4a-8671c9645edf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '.version_select at 0x7f3412ff75e0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:33:57.913416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2bcd167a-d3c8-4483-9f4a-8671c9645edf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981276794" status: 202 len: 0 microversion: 2.1 time: 0.095342 Jul 14 11:33:57.914010 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 629/1298] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jul 14 11:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981276794 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:33:58.657941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-723c3b56-4fd2-42bd-b328-e76bee101f3a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: .version_select at 0x7f3412469ee0>, body: {"keypair": {"name": "tempest-keypair-570820329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiWQ5YISl4+zIIJ7yNnm5+iKtSCJs5VDJI7AjuXQN/MI8LgLgnh9ryAfGm2L31q8dqgsou0CvMAWzClh0rr7kmvWsdDXbHWr10OmZ3vhyQw+KkRa0e+eBBsl5BuOxD+Hw=="}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:33:58.673318 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-723c3b56-4fd2-42bd-b328-e76bee101f3a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:33:58.677135 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-723c3b56-4fd2-42bd-b328-e76bee101f3a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:33:58.770339 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-723c3b56-4fd2-42bd-b328-e76bee101f3a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116235 Jul 14 11:33:58.770944 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 670/1299] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:33:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:34:00.899723 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-266765798", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d0793d7-484a-4624-89ee-2256db3098b1"}], "security_groups": [{"name": "tempest-securitygroup--1866202831"}], "key_name": "tempest-keypair-570820329", "user_data": "}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:34:01.006897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.network.neutron [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] validate_networks() for [('7d0793d7-484a-4624-89ee-2256db3098b1', None, None, None, None, None)] {{(pid=118244) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:34:01.381162 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:34:01.381591 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image limits 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:34:01.382071 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:34:01.382483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image pref 0:0:0 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:34:01.382902 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.virt.hardware [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118244) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:34:01.392670 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:01.393113 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:01.393908 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:01.394358 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:01.412326 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:34:01.416241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:34:01.427322 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Going to run 1 instances... {{(pid=118244) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:34:01.429582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118244) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:34:01.583573 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e10186f3-fa5c-4824-976d-cb73175fa6f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.688513 Jul 14 11:34:01.584225 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 630/1300] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:34:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:34:01.594695 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c77f91e1-31f9-4a92-8f41-e0458d4221ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:01.595337 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-c77f91e1-31f9-4a92-8f41-e0458d4221ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:01.652460 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-c77f91e1-31f9-4a92-8f41-e0458d4221ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:01.659570 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c77f91e1-31f9-4a92-8f41-e0458d4221ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1240 microversion: 2.1 time: 0.069238 Jul 14 11:34:01.660145 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 671/1301] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:01 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:02.677523 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:02.678240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:02.685023 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:02.685478 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:02.686311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:02.686756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:02.750029 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:02.758068 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-5a914b0e-537e-4b79-9c03-c0ab917fea37 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1244 microversion: 2.1 time: 0.085308 Jul 14 11:34:02.768639 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 631/1302] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:02 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:03.774766 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:03.775518 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:03.783290 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:03.783831 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:03.784529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:03.784959 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:03.997951 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:04.009981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-71b9d71c-0b27-4263-b5ba-5786a2e04002 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1300 microversion: 2.1 time: 0.239043 Jul 14 11:34:04.011203 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 672/1303] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:03 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1300 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:05.029357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:05.030222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:05.036907 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:05.042674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:05.042674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:05.042674 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:05.173103 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:05.181266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-372cf7fe-d9d9-435f-bdc4-5fc65d8d6030 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.155585 Jul 14 11:34:05.182185 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 632/1304] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:05 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:05.712519 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-751b4abe-13ef-410a-b026-c07338e14606 req-fdc827cc-ec91-4d8c-bba4-5367513b239f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be16dccc-54fd-4747-a69f-ce9f79cce821", "tag": "75de1d31-ef08-4669-a3fd-e4773766f581"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:34:05.727931 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-751b4abe-13ef-410a-b026-c07338e14606 req-fdc827cc-ec91-4d8c-bba4-5367513b239f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:05.734352 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-751b4abe-13ef-410a-b026-c07338e14606 req-fdc827cc-ec91-4d8c-bba4-5367513b239f service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:05.743610 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-751b4abe-13ef-410a-b026-c07338e14606 req-fdc827cc-ec91-4d8c-bba4-5367513b239f service nova] Creating event network-changed:75de1d31-ef08-4669-a3fd-e4773766f581 for instance be16dccc-54fd-4747-a69f-ce9f79cce821 on hv-cinder-82282 Jul 14 11:34:05.750305 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-751b4abe-13ef-410a-b026-c07338e14606 req-fdc827cc-ec91-4d8c-bba4-5367513b239f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044911 Jul 14 11:34:05.750305 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 673/1305] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:34:06.199149 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:06.199782 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:06.207483 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:06.207932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:06.208712 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:06.209144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:06.348996 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:06.356756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a56ddcec-7714-4afb-a31d-219326b6f769 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.161426 Jul 14 11:34:06.357333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 633/1306] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:06 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:07.374976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:07.375671 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:07.382389 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:07.382838 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:07.383630 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:07.384086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:07.521994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:07.529643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-1a0abc18-bb42-42b6-83db-a693b1cb189c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.159591 Jul 14 11:34:07.530941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 674/1307] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:07 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:08.548234 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:08.548846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:08.556389 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:08.556846 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:08.557643 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:08.558118 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:08.694198 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:08.701655 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7aca273f-04a8-44ed-9a5b-d46902e28628 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.158025 Jul 14 11:34:08.702957 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 634/1308] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:08 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:09.720436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:09.721057 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:09.727521 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:09.727960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:09.728720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:09.729149 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:09.869571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:09.877976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2c143c14-c8f5-4ce7-a442-ea7104f4fad6 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.162503 Jul 14 11:34:09.878547 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 675/1309] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:09 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:10.895561 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:10.896243 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:10.902890 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:10.903368 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:10.904211 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:10.904637 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:11.042334 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:11.053269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-86ad1dac-8b9b-4b42-ad88-7ce8b4edd525 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.158322 Jul 14 11:34:11.053269 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 635/1310] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:10 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:12.067040 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:12.067852 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:12.071426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=6 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:12.075438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:12.075890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:12.076676 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:12.077122 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:12.294451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:12.300282 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-d9af94d3-473a-45ee-9e90-f8a6c564fd03 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.237251 Jul 14 11:34:12.300909 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 676/1311] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:12 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:13.110168 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:13.111221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:13.171990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-2b340826-034d-40cf-8352-3dedc238cae2 req-943f21ea-fdee-45d7-b7dd-06fc522569d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be16dccc-54fd-4747-a69f-ce9f79cce821", "name": "network-vif-plugged", "status": "completed", "tag": "75de1d31-ef08-4669-a3fd-e4773766f581"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:34:13.180504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-2b340826-034d-40cf-8352-3dedc238cae2 req-943f21ea-fdee-45d7-b7dd-06fc522569d5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:13.180984 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-2b340826-034d-40cf-8352-3dedc238cae2 req-943f21ea-fdee-45d7-b7dd-06fc522569d5 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:13.193271 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-2b340826-034d-40cf-8352-3dedc238cae2 req-943f21ea-fdee-45d7-b7dd-06fc522569d5 service nova] Creating event network-vif-plugged:75de1d31-ef08-4669-a3fd-e4773766f581 for instance be16dccc-54fd-4747-a69f-ce9f79cce821 on hv-cinder-82282 Jul 14 11:34:13.199031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-2b340826-034d-40cf-8352-3dedc238cae2 req-943f21ea-fdee-45d7-b7dd-06fc522569d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093972 Jul 14 11:34:13.199673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 636/1312] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:34:13.317313 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:13.317955 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:13.324658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:13.328052 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:13.328052 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:13.328052 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:13.331154 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:13.458979 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:13.466353 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-032afebb-4747-4aa7-a039-0480c5de97c9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.152936 Jul 14 11:34:13.466920 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 677/1313] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:13 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:14.485814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:14.486553 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:14.492922 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:14.493376 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:14.494156 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:14.494600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:14.497262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=93 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:14.636519 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:14.648586 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ba524aee-56f6-4833-bc78-ec4fb45e93cb tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1366 microversion: 2.1 time: 0.168025 Jul 14 11:34:14.649672 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 637/1314] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:14 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:15.667633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:15.668415 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:15.673199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:15.678119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:15.678553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:15.679363 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:15.679792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:15.823225 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:34:15.834757 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-71b003e2-5a6f-4d64-9bce-641c274ecf47 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1555 microversion: 2.1 time: 0.171049 Jul 14 11:34:15.835387 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 678/1315] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:34:15 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:34:15.851822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:34:15.852419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:34:15.855028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:15.860401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:15.860863 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:15.863467 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:15.863467 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:15.944541 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-87efa95c-98c7-4511-abd5-0338e8dc22f5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096890 Jul 14 11:34:15.945138 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 638/1316] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:34:15 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:34:16.980743 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-096b2ad6-9f75-435f-a1ee-b7902b3e9372 req-4f327506-98f4-4895-a766-213d3b08d23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be16dccc-54fd-4747-a69f-ce9f79cce821", "tag": "75de1d31-ef08-4669-a3fd-e4773766f581"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:34:16.991419 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-096b2ad6-9f75-435f-a1ee-b7902b3e9372 req-4f327506-98f4-4895-a766-213d3b08d23d service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:34:16.991862 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-096b2ad6-9f75-435f-a1ee-b7902b3e9372 req-4f327506-98f4-4895-a766-213d3b08d23d service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:34:17.003911 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-096b2ad6-9f75-435f-a1ee-b7902b3e9372 req-4f327506-98f4-4895-a766-213d3b08d23d service nova] Creating event network-changed:75de1d31-ef08-4669-a3fd-e4773766f581 for instance be16dccc-54fd-4747-a69f-ce9f79cce821 on hv-cinder-82282 Jul 14 11:34:17.009197 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-096b2ad6-9f75-435f-a1ee-b7902b3e9372 req-4f327506-98f4-4895-a766-213d3b08d23d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Jul 14 11:34:17.009808 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 679/1317] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:10.060880 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=12 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:35:10.061789 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:10.062164 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:10.065286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=9 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:35:10.066060 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-197ef3b5-0f0a-465b-9495-25893be9c9e9 req-b7627e1b-0511-4fd8-bd7b-cf0b70533182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d8639b-5827-4f1f-b5d8-12ad5b40214d", "tag": "b22e93ca-1ce7-461b-916b-f2aa4b4fc42b"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:10.071664 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:10.072251 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:10.073215 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:10.074031 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:10.076865 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-197ef3b5-0f0a-465b-9495-25893be9c9e9 req-b7627e1b-0511-4fd8-bd7b-cf0b70533182 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:10.078208 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-197ef3b5-0f0a-465b-9495-25893be9c9e9 req-b7627e1b-0511-4fd8-bd7b-cf0b70533182 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:10.090106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-197ef3b5-0f0a-465b-9495-25893be9c9e9 req-b7627e1b-0511-4fd8-bd7b-cf0b70533182 service nova] Creating event network-changed:b22e93ca-1ce7-461b-916b-f2aa4b4fc42b for instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d on hv-cinder-82282 Jul 14 11:35:10.096463 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-197ef3b5-0f0a-465b-9495-25893be9c9e9 req-b7627e1b-0511-4fd8-bd7b-cf0b70533182 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037182 Jul 14 11:35:10.097273 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 680/1318] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:35:10.106673 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:35:10.492209 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-d140de57-afea-4005-82e7-69677a0eb7f9 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 204 len: 0 microversion: 2.1 time: 0.436331 Jul 14 11:35:10.493288 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 639/1319] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:35:10 2022] DELETE /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:35:10.503017 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:10.504053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:10.511701 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:10.512150 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:10.513265 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:10.513923 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:10.676308 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:10.685217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-05047770-24e2-47de-a47e-50a7902269a8 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1579 microversion: 2.1 time: 0.187290 Jul 14 11:35:10.685802 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 681/1320] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:10 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1579 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:35:11.704827 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:11.706442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:11.714801 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:11.720824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:11.720824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:11.720824 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:11.888003 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:11.899595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-69f4f74c-fa0a-4999-877c-419163f3b700 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1579 microversion: 2.1 time: 0.199408 Jul 14 11:35:11.900570 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 640/1321] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:11 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:12.923230 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:12.923861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:12.930664 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:12.933000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:12.933000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:12.933000 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:12.965985 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-076af86a-3854-43cd-b622-f19bc228984f req-4f629296-d5c6-4c13-8ded-3d7b627e36e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d8639b-5827-4f1f-b5d8-12ad5b40214d", "name": "network-vif-deleted", "tag": "b22e93ca-1ce7-461b-916b-f2aa4b4fc42b"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:12.976791 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-076af86a-3854-43cd-b622-f19bc228984f req-4f629296-d5c6-4c13-8ded-3d7b627e36e0 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:12.977235 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-076af86a-3854-43cd-b622-f19bc228984f req-4f629296-d5c6-4c13-8ded-3d7b627e36e0 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:12.989926 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-076af86a-3854-43cd-b622-f19bc228984f req-4f629296-d5c6-4c13-8ded-3d7b627e36e0 service nova] Creating event network-vif-deleted:b22e93ca-1ce7-461b-916b-f2aa4b4fc42b for instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d on hv-cinder-82282 Jul 14 11:35:12.995470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-076af86a-3854-43cd-b622-f19bc228984f req-4f629296-d5c6-4c13-8ded-3d7b627e36e0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Jul 14 11:35:12.996130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 641/1322] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:35:13.011654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:13.021148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7663fdf2-0042-4eb7-9740-55177f5de25d tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1393 microversion: 2.1 time: 0.101878 Jul 14 11:35:13.021751 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 682/1323] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:12 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1393 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:14.042659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:14.043419 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:14.049964 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:14.050416 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:14.051241 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:14.051678 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:14.084781 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:14.085137 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:14.085595 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lazy-loading 'fault' on Instance uuid a8d8639b-5827-4f1f-b5d8-12ad5b40214d {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:35:14.130388 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:14.138414 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a7a2eea5-a3c1-41dc-b39b-2e09c4eff0de tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 200 len: 1231 microversion: 2.1 time: 0.100392 Jul 14 11:35:14.138983 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 642/1324] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:14 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 1231 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:15.157648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:15.158259 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: a8d8639b-5827-4f1f-b5d8-12ad5b40214d] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:15.164686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:15.165132 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:15.165922 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:15.166364 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:15.180365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] HTTP exception thrown: Instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d could not be found. Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Request method failure captured: Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d HTTP/1.1 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_1Cz2M9OX7lCI5Xeh7xYqLFPclc15vC5P0P8HFBkzxgIfJ5fjYtm-IyLcT9eQsvmYsa1AkddcQZRS5WUOkub-v80c0Wr4NMngNocnhVosW2kjrMC6FqZTU8Ofw-TymhhT1vvNR73V0nmMjwczblz4C34dh6HCChb6Vh7wyiIe4nxg0 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:35:15.182055 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f3904fb55e2e463fb548333d97601ce5", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: c466157931bd41baabb01abbec492b4f Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d could not be found. Jul 14 11:35:15.183845 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'a8d8639b-5827-4f1f-b5d8-12ad5b40214d'} Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d could not be found. Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:35:15.184970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d could not be found. Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d could not be found. Jul 14 11:35:15.186441 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:15.187850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Returning 404 to user: Instance a8d8639b-5827-4f1f-b5d8-12ad5b40214d could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:35:15.187850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-62b1a15d-1046-49a2-87df-e06ad3e86e97 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d" status: 404 len: 111 microversion: 2.1 time: 0.030736 Jul 14 11:35:15.187850 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 683/1325] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:15 2022] GET /compute/v2.1/servers/a8d8639b-5827-4f1f-b5d8-12ad5b40214d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:35:18.647359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:18.649437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:18.656645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-9510324c-636d-46e1-ae5c-90783fd4954a req-bd59adf8-e92a-4b60-ac8f-46bc916344b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30581246-1a52-4bcf-ae18-ca92ecd7366e", "tag": "adeb76b3-7b8e-4d92-bddc-fcfc90be61cf"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:18.665264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:18.665732 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:18.666582 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:18.667046 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:18.675729 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-9510324c-636d-46e1-ae5c-90783fd4954a req-bd59adf8-e92a-4b60-ac8f-46bc916344b6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:18.681081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-9510324c-636d-46e1-ae5c-90783fd4954a req-bd59adf8-e92a-4b60-ac8f-46bc916344b6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:18.691625 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-9510324c-636d-46e1-ae5c-90783fd4954a req-bd59adf8-e92a-4b60-ac8f-46bc916344b6 service nova] Creating event network-changed:adeb76b3-7b8e-4d92-bddc-fcfc90be61cf for instance 30581246-1a52-4bcf-ae18-ca92ecd7366e on hv-cinder-82282 Jul 14 11:35:18.697391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-9510324c-636d-46e1-ae5c-90783fd4954a req-bd59adf8-e92a-4b60-ac8f-46bc916344b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044832 Jul 14 11:35:18.698546 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 684/1326] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:18.698745 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:35:19.006688 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-4903f9c7-2458-4af9-bcd0-0519c5a553a1 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "DELETE /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 204 len: 0 microversion: 2.1 time: 0.363109 Jul 14 11:35:19.007563 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 643/1327] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:35:18 2022] DELETE /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:35:19.016639 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:19.017350 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:19.025647 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:19.027263 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:19.028190 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:19.028648 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:19.189655 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:19.198839 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2c14b1c1-39f3-4732-9ecd-27e587fa014f tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1578 microversion: 2.1 time: 0.186716 Jul 14 11:35:19.204401 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 685/1328] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:19 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:20.217124 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:20.218403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:20.224840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:20.225292 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:20.226080 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:20.226518 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:20.365635 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:20.373858 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b10b894b-1478-4e08-b259-51386a68245a tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1460 microversion: 2.1 time: 0.160962 Jul 14 11:35:20.374442 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 644/1329] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:20 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 11:35:21.121254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-5579ea36-2213-447d-bb96-97dc8a39a562 req-cb1153da-b6d1-4ecd-bcf5-090c70b6cc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30581246-1a52-4bcf-ae18-ca92ecd7366e", "name": "network-vif-deleted", "tag": "adeb76b3-7b8e-4d92-bddc-fcfc90be61cf"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:21.132586 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-5579ea36-2213-447d-bb96-97dc8a39a562 req-cb1153da-b6d1-4ecd-bcf5-090c70b6cc21 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:21.133357 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-5579ea36-2213-447d-bb96-97dc8a39a562 req-cb1153da-b6d1-4ecd-bcf5-090c70b6cc21 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:21.154627 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-5579ea36-2213-447d-bb96-97dc8a39a562 req-cb1153da-b6d1-4ecd-bcf5-090c70b6cc21 service nova] Creating event network-vif-deleted:adeb76b3-7b8e-4d92-bddc-fcfc90be61cf for instance 30581246-1a52-4bcf-ae18-ca92ecd7366e on hv-cinder-82282 Jul 14 11:35:21.162279 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-5579ea36-2213-447d-bb96-97dc8a39a562 req-cb1153da-b6d1-4ecd-bcf5-090c70b6cc21 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046077 Jul 14 11:35:21.165902 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 686/1330] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:21.392974 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:21.393725 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:21.403572 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:21.404032 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:21.404829 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:21.405286 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:21.486161 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:21.496498 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-cc2680a1-720f-4b3d-abf1-622b01cad889 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1226 microversion: 2.1 time: 0.107576 Jul 14 11:35:21.497351 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 645/1331] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:21 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:22.520967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:22.521715 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:22.528020 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:22.529066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:22.529199 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:22.529633 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:22.562592 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:22.563035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:22.563515 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lazy-loading 'fault' on Instance uuid 30581246-1a52-4bcf-ae18-ca92ecd7366e {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:35:22.615025 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c466157931bd41baabb01abbec492b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3904fb55e2e463fb548333d97601ce5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:22.627553 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-e9904153-ab47-4022-94c1-0f5bd6ad60ce tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 200 len: 1185 microversion: 2.1 time: 0.111388 Jul 14 11:35:22.628790 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 687/1332] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:22 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 1185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:23.645435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:23.646051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 30581246-1a52-4bcf-ae18-ca92ecd7366e] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:23.652676 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:23.653134 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:23.653903 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:23.654345 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:23.668435 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] HTTP exception thrown: Instance 30581246-1a52-4bcf-ae18-ca92ecd7366e could not be found. Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Request method failure captured: Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e HTTP/1.1 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_1Cz2M9OX7lCI5Xeh7xYqLFPclc15vC5P0P8HFBkzxgIfJ5fjYtm-IyLcT9eQsvmYsa1AkddcQZRS5WUOkub-v80c0Wr4NMngNocnhVosW2kjrMC6FqZTU8Ofw-TymhhT1vvNR73V0nmMjwczblz4C34dh6HCChb6Vh7wyiIe4nxg0 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:35:23.670084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f3904fb55e2e463fb548333d97601ce5", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: c466157931bd41baabb01abbec492b4f Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 30581246-1a52-4bcf-ae18-ca92ecd7366e could not be found. Jul 14 11:35:23.672366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '30581246-1a52-4bcf-ae18-ca92ecd7366e'} Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30581246-1a52-4bcf-ae18-ca92ecd7366e could not be found. Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:35:23.673487 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30581246-1a52-4bcf-ae18-ca92ecd7366e could not be found. Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30581246-1a52-4bcf-ae18-ca92ecd7366e could not be found. Jul 14 11:35:23.674939 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:23.676309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Returning 404 to user: Instance 30581246-1a52-4bcf-ae18-ca92ecd7366e could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:35:23.676309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-7ac6afbc-252c-4b42-b404-7215cba044ea tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e" status: 404 len: 111 microversion: 2.1 time: 0.029957 Jul 14 11:35:23.676309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 646/1333] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:23 2022] GET /compute/v2.1/servers/30581246-1a52-4bcf-ae18-ca92ecd7366e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:35:24.197600 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:24.198172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:24.205382 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:24.205834 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:24.206603 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:24.207035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:24.221733 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] HTTP exception thrown: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Request method failure captured: Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 HTTP/1.1 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_1Cz2M9OX7lCI5Xeh7xYqLFPclc15vC5P0P8HFBkzxgIfJ5fjYtm-IyLcT9eQsvmYsa1AkddcQZRS5WUOkub-v80c0Wr4NMngNocnhVosW2kjrMC6FqZTU8Ofw-TymhhT1vvNR73V0nmMjwczblz4C34dh6HCChb6Vh7wyiIe4nxg0 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:35:24.223446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f3904fb55e2e463fb548333d97601ce5", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: c466157931bd41baabb01abbec492b4f Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.225094 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1beae9bb-3e63-453f-9262-7d2b446ea357'} Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:35:24.225965 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.227470 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.229070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Returning 404 to user: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:35:24.229070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ada507dd-cded-417c-be95-a0b491f98d00 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 404 len: 111 microversion: 2.1 time: 0.031126 Jul 14 11:35:24.229070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 688/1334] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:35:24 2022] DELETE /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:35:24.238663 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:24.239320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] [instance: 1beae9bb-3e63-453f-9262-7d2b446ea357] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:24.245564 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:24.246018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:24.246798 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:24.247274 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:24.264086 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] HTTP exception thrown: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Request method failure captured: Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 HTTP/1.1 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_1Cz2M9OX7lCI5Xeh7xYqLFPclc15vC5P0P8HFBkzxgIfJ5fjYtm-IyLcT9eQsvmYsa1AkddcQZRS5WUOkub-v80c0Wr4NMngNocnhVosW2kjrMC6FqZTU8Ofw-TymhhT1vvNR73V0nmMjwczblz4C34dh6HCChb6Vh7wyiIe4nxg0 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:35:24.265729 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f3904fb55e2e463fb548333d97601ce5", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f3904fb55e2e463fb548333d97601ce5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: f3904fb55e2e463fb548333d97601ce5 Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-TestVolumeBootPattern-1468633560 Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: c466157931bd41baabb01abbec492b4f Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-TestVolumeBootPattern-1468633560-project Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.267385 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '1beae9bb-3e63-453f-9262-7d2b446ea357'} Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:35:24.268278 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. Jul 14 11:35:24.269529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:24.270697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Returning 404 to user: Instance 1beae9bb-3e63-453f-9262-7d2b446ea357 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:35:24.270697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ae3f353d-f5ac-4d3f-b006-187db0d559ef tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357" status: 404 len: 111 microversion: 2.1 time: 0.033893 Jul 14 11:35:24.270697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 647/1335] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:24 2022] GET /compute/v2.1/servers/1beae9bb-3e63-453f-9262-7d2b446ea357 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:35:25.729669 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-c238bd58-d7de-4206-a0ff-b1c4a4597f35 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] Calling method '.version_select at 0x7f3412201310>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:25.789783 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-c238bd58-d7de-4206-a0ff-b1c4a4597f35 tempest-TestVolumeBootPattern-1468633560 tempest-TestVolumeBootPattern-1468633560-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1262803912" status: 202 len: 0 microversion: 2.1 time: 0.066795 Jul 14 11:35:25.790400 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 689/1336] 10.222.0.59 () {58 vars in 1262 bytes} [Thu Jul 14 11:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1262803912 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:35:30.219081 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:35:30.219820 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:35:32.250441 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:32.251048 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:32.257765 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:32.261439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:32.261439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:32.261439 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:32.287967 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-f0915ccb-9b3e-4a2a-9d15-9a5dbdf685d1 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/ips" status: 200 len: 148 microversion: 2.1 time: 0.127771 Jul 14 11:35:32.288449 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 648/1337] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:35:32 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/ips => generated 148 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:35.005321 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=36 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:35:35.011864 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53997c2d-b012-44bd-9d0d-fd16b38bab56"}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:35.012837 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:35.020876 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:35.022734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:35.022734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:35.022952 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:35.752269 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-047cad53-4dec-4e16-9364-c0f9969fcd71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749031 Jul 14 11:35:35.752873 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 690/1338] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:35:35 2022] POST /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:43.242309 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53997c2d-b012-44bd-9d0d-fd16b38bab56"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:43.243562 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:43.246116 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:35:43.246894 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:35:43.251936 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:43.252510 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:43.256481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:43.256481 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:43.333307 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Invalid volume: volume 53997c2d-b012-44bd-9d0d-fd16b38bab56 is already attached to instances: be16dccc-54fd-4747-a69f-ce9f79cce821 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: POST /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments HTTP/1.1 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 74 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:35:43.335089 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {"volumeAttachment": {"volumeId": "53997c2d-b012-44bd-9d0d-fd16b38bab56"}} Jul 14 11:35:43.336993 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Invalid volume: volume 53997c2d-b012-44bd-9d0d-fd16b38bab56 is already attached to instances: be16dccc-54fd-4747-a69f-ce9f79cce821 Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'server_id': 'be16dccc-54fd-4747-a69f-ce9f79cce821', 'body': {'volumeAttachment': {'volumeId': '53997c2d-b012-44bd-9d0d-fd16b38bab56'}}} Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 53997c2d-b012-44bd-9d0d-fd16b38bab56 is already attached to instances: be16dccc-54fd-4747-a69f-ce9f79cce821 Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:43.338051 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 53997c2d-b012-44bd-9d0d-fd16b38bab56 is already attached to instances: be16dccc-54fd-4747-a69f-ce9f79cce821 Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:43.343084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 53997c2d-b012-44bd-9d0d-fd16b38bab56 is already attached to instances: be16dccc-54fd-4747-a69f-ce9f79cce821 Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 400 to user: Invalid volume: volume 53997c2d-b012-44bd-9d0d-fd16b38bab56 is already attached to instances: be16dccc-54fd-4747-a69f-ce9f79cce821 {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-e3639291-dfd7-4130-b1a4-b5713216ea9a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098370 Jul 14 11:35:43.345504 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 649/1339] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:35:43 2022] POST /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 11:35:43.399580 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:43.400106 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:43.402086 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:35:43.407861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:43.408194 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:43.408994 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:43.409437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:43.491507 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'services' on Instance uuid be16dccc-54fd-4747-a69f-ce9f79cce821 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:35:43.713146 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-12650c4c-3c96-4476-a80f-9dc94ffe062a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments/53997c2d-b012-44bd-9d0d-fd16b38bab56" status: 202 len: 0 microversion: 2.1 time: 0.318233 Jul 14 11:35:43.713716 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 691/1340] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:35:43 2022] DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments/53997c2d-b012-44bd-9d0d-fd16b38bab56 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:35:43.722552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:43.723546 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:43.730200 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:43.730661 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:43.731718 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:43.732158 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:43.761324 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ff9ea586-de09-4bbc-8536-6683c2896931 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Jul 14 11:35:43.761874 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 650/1341] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:35:43 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:44.773535 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:44.774616 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:44.781105 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:44.782137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:44.782919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:44.783391 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:44.813738 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-4927c906-153c-4545-a628-cf2cda84716e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045139 Jul 14 11:35:44.814317 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 692/1342] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:35:44 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:35:44.877474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:44.877474 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:44.881462 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:44.881938 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:44.882768 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:44.883237 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:44.911011 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Going to try to terminate instance {{(pid=118244) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:35:45.160589 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-682b3387-34fe-4a8c-aa4d-c02b4bf217cf tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 204 len: 0 microversion: 2.1 time: 0.290351 Jul 14 11:35:45.161088 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 651/1343] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:35:44 2022] DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:35:45.169370 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:45.170650 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:45.178196 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:45.178642 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:45.179446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:45.179879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:45.317010 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:45.324879 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-29bf98f1-f742-4fdc-aff4-428f7cde03a5 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1679 microversion: 2.1 time: 0.159388 Jul 14 11:35:45.325445 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 693/1344] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:45 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:46.343821 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:46.344534 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:46.351988 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:46.352438 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:46.353218 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:46.353645 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:46.489194 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:46.496779 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-3b442a6a-215e-44d9-baf7-118469a55a77 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1679 microversion: 2.1 time: 0.157303 Jul 14 11:35:46.497347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 652/1345] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:46 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:47.513254 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:47.514529 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:47.521141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:47.521599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:47.522471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:47.522967 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:47.730435 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:47.739059 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-932067de-7a6c-4d01-9a09-6acaa8ac5dee tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1679 microversion: 2.1 time: 0.229697 Jul 14 11:35:47.739659 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 694/1346] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:47 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:48.226417 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-c6efd315-4b1b-41f6-b840-b626cb9f663c req-4fa59e3d-d683-416b-a472-ae1a2f66fae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be16dccc-54fd-4747-a69f-ce9f79cce821", "name": "network-vif-deleted", "tag": "75de1d31-ef08-4669-a3fd-e4773766f581"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:48.241263 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c6efd315-4b1b-41f6-b840-b626cb9f663c req-4fa59e3d-d683-416b-a472-ae1a2f66fae6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:48.241811 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c6efd315-4b1b-41f6-b840-b626cb9f663c req-4fa59e3d-d683-416b-a472-ae1a2f66fae6 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:48.254515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-c6efd315-4b1b-41f6-b840-b626cb9f663c req-4fa59e3d-d683-416b-a472-ae1a2f66fae6 service nova] Creating event network-vif-deleted:75de1d31-ef08-4669-a3fd-e4773766f581 for instance be16dccc-54fd-4747-a69f-ce9f79cce821 on hv-cinder-82282 Jul 14 11:35:48.260023 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-c6efd315-4b1b-41f6-b840-b626cb9f663c req-4fa59e3d-d683-416b-a472-ae1a2f66fae6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037202 Jul 14 11:35:48.260714 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 653/1347] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:48.756432 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:48.757044 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:48.763770 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:48.764219 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:48.764993 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:48.765424 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:48.799099 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:48.799578 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:48.800031 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'fault' on Instance uuid be16dccc-54fd-4747-a69f-ce9f79cce821 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:35:48.841759 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:48.850483 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-32b9db33-c8ac-408f-9606-3aded01e13b2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 200 len: 1330 microversion: 2.1 time: 0.097808 Jul 14 11:35:48.851198 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 695/1348] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:48 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:49.869554 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:49.870163 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:49.876575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:49.876986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:49.877762 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:49.878193 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:49.893659 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 HTTP/1.1 Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:35:49.895895 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:35:49.897705 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': 'be16dccc-54fd-4747-a69f-ce9f79cce821'} Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:35:49.898641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:35:49.900181 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:35:49.901422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:35:49.901422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-bd00764c-1969-453c-af77-9f938cdd6f80 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 404 len: 111 microversion: 2.1 time: 0.033204 Jul 14 11:35:49.901422 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 654/1349] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:49 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:35:49.906972 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-144c0377-bfbd-42f1-a1bb-b13d38b93b40 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '.version_select at 0x7f34124691f0>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:49.994861 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-144c0377-bfbd-42f1-a1bb-b13d38b93b40 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-570820329" status: 202 len: 0 microversion: 2.1 time: 0.091590 Jul 14 11:35:49.995500 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 696/1350] 10.222.0.59 () {58 vars in 1217 bytes} [Thu Jul 14 11:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-570820329 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:35:50.978990 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-02924a10-2cd7-4857-9e06-fa3c75f0f99b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: .version_select at 0x7f3416c32550>, body: {"keypair": {"name": "tempest-keypair-1901494932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLsYQxF3zyYRbP2v3yVuV5obZIYjELKAkBx18QhMWMldb/VIZksErSxiqdp6G8Lvai9jGP9JizqZEbWxRz2mOMAMfzMebqFlGi0bs/DPWR0JDHKKL9ibpFjJndek8Vv1w=="}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:50.993759 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-02924a10-2cd7-4857-9e06-fa3c75f0f99b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:35:50.997552 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.quota [None req-02924a10-2cd7-4857-9e06-fa3c75f0f99b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'key_pairs'} {{(pid=118244) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:35:51.069264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-02924a10-2cd7-4857-9e06-fa3c75f0f99b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094049 Jul 14 11:35:51.069887 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 655/1351] 10.222.0.59 () {60 vars in 1158 bytes} [Thu Jul 14 11:35:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:53.335343 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-691121977", "imageRef": "c1a60e01-8097-42ca-b8bc-c0981efaaf02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d0793d7-484a-4624-89ee-2256db3098b1"}], "security_groups": [{"name": "tempest-securitygroup--2100153664"}], "key_name": "tempest-keypair-1901494932", "user_data": "}} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:53.440438 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.network.neutron [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] validate_networks() for [('7d0793d7-484a-4624-89ee-2256db3098b1', None, None, None, None, None)] {{(pid=118245) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 11:35:53.931624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 11:35:53.932050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image limits 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 11:35:53.932528 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Flavor pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 11:35:53.932941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Image pref 0:0:0 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 11:35:53.933361 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.virt.hardware [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118245) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 11:35:53.942686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:53.943218 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:53.944053 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:53.944488 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:53.963643 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 11:35:53.967752 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.quota [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Getting quotas for user 796d04c1e8a348d9ba3832cb0ede80f3 and project 9a3aebe2cb6342ce80d1979e6c330815. Resources: {'instances', 'ram', 'cores'} {{(pid=118245) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 11:35:53.979342 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Going to run 1 instances... {{(pid=118245) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 11:35:53.981869 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1a60e01-8097-42ca-b8bc-c0981efaaf02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118245) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 11:35:54.121372 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ec4fa8d2-3e82-4b98-a541-cc4222d66052 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.790831 Jul 14 11:35:54.122008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 697/1352] 10.222.0.59 () {60 vars in 1146 bytes} [Thu Jul 14 11:35:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 11:35:54.133380 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8fb168bf-1285-4756-8936-39ef41113f01 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:54.134034 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8fb168bf-1285-4756-8936-39ef41113f01 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:54.193221 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8fb168bf-1285-4756-8936-39ef41113f01 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:54.200602 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8fb168bf-1285-4756-8936-39ef41113f01 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1241 microversion: 2.1 time: 0.072312 Jul 14 11:35:54.201909 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 656/1353] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:54 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:55.220423 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:55.221146 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:55.228474 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:55.228919 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:55.229693 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:55.230126 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:55.294525 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:55.304001 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7e4fd2eb-17fd-4b43-b125-09856add5ab3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1245 microversion: 2.1 time: 0.088086 Jul 14 11:35:55.304589 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 698/1354] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:55 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:56.321340 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:56.324354 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:56.328864 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:56.329577 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:56.330373 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:56.330847 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:56.399485 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:56.407348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ce0a894c-d114-4197-b041-eeb9e8d09a26 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1311 microversion: 2.1 time: 0.089889 Jul 14 11:35:56.407877 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 657/1355] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:56 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:57.428320 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:57.428886 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:57.435406 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:57.435854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:57.436636 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:57.437066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:57.666016 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:57.673612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-aac4064d-f9e2-4993-bc35-5024843c121e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.249617 Jul 14 11:35:57.674201 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 699/1356] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:57 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:58.193626 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-689e835a-8cbd-4b15-bdf5-2b804f6d307e req-9c113a21-1530-4827-8c24-d135ad2e8788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751634d5-5f86-480b-94a5-00022ae4b030", "tag": "3e3708d2-799c-4cca-ace4-452456b40a62"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:35:58.207111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-689e835a-8cbd-4b15-bdf5-2b804f6d307e req-9c113a21-1530-4827-8c24-d135ad2e8788 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:58.207111 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-689e835a-8cbd-4b15-bdf5-2b804f6d307e req-9c113a21-1530-4827-8c24-d135ad2e8788 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:58.219421 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-689e835a-8cbd-4b15-bdf5-2b804f6d307e req-9c113a21-1530-4827-8c24-d135ad2e8788 service nova] Creating event network-changed:3e3708d2-799c-4cca-ace4-452456b40a62 for instance 751634d5-5f86-480b-94a5-00022ae4b030 on hv-cinder-82282 Jul 14 11:35:58.225244 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-689e835a-8cbd-4b15-bdf5-2b804f6d307e req-9c113a21-1530-4827-8c24-d135ad2e8788 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043560 Jul 14 11:35:58.226387 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 658/1357] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:35:58.692571 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:58.693288 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:58.699964 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:58.700410 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:58.701175 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:58.701599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:58.900097 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:35:58.907574 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0380113a-e61e-41a4-851a-3d9dc9b0b015 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.219508 Jul 14 11:35:58.908324 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 700/1358] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:58 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:35:59.925216 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:35:59.926402 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:35:59.932769 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:59.933217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:35:59.934028 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:35:59.934464 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:00.065968 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:00.074615 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-03287369-c0d6-4056-a885-02c97db93051 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.153750 Jul 14 11:36:00.075201 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 659/1359] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:35:59 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:01.091970 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:01.092605 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:01.099107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:01.099598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:01.100471 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:01.100960 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:01.233329 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:01.241501 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-523c54a9-d0a2-4c10-ab0d-4ecc00fa245d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.152780 Jul 14 11:36:01.242323 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 701/1360] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:01 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:02.258473 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:02.259084 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:02.265624 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:02.266075 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:02.266844 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:02.267313 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:02.398611 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:02.405946 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-b5e9cdcc-ca43-4d9f-9dac-57fbcd004254 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.151908 Jul 14 11:36:02.406660 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 660/1361] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:02 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:03.423073 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:03.423794 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:03.430466 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:03.430854 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:03.431658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:03.432090 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:03.565141 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:03.573492 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-0677e0dc-2d45-40eb-8e5d-d533d5862fec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.154279 Jul 14 11:36:03.574056 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 702/1362] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:03 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:04.590818 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:04.591470 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:04.593978 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell0:SELECT=6 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:04.600222 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:04.601357 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:04.606401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:04.606401 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:04.750133 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:04.757932 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-8b1ba582-41bc-46f6-864f-def6455039f2 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.171099 Jul 14 11:36:04.758496 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 661/1363] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:04 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:05.614403 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-6e230702-e6ea-421f-b372-658aa76647d3 req-94e684f6-8371-48ef-94a9-47ad5fced6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751634d5-5f86-480b-94a5-00022ae4b030", "name": "network-vif-plugged", "status": "completed", "tag": "3e3708d2-799c-4cca-ace4-452456b40a62"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:05.618748 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:05.621409 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell0:SELECT=6 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:05.625120 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-6e230702-e6ea-421f-b372-658aa76647d3 req-94e684f6-8371-48ef-94a9-47ad5fced6ec service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:05.625564 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-6e230702-e6ea-421f-b372-658aa76647d3 req-94e684f6-8371-48ef-94a9-47ad5fced6ec service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:05.629365 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:05.637148 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-6e230702-e6ea-421f-b372-658aa76647d3 req-94e684f6-8371-48ef-94a9-47ad5fced6ec service nova] Creating event network-vif-plugged:3e3708d2-799c-4cca-ace4-452456b40a62 for instance 751634d5-5f86-480b-94a5-00022ae4b030 on hv-cinder-82282 Jul 14 11:36:05.642223 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-6e230702-e6ea-421f-b372-658aa76647d3 req-94e684f6-8371-48ef-94a9-47ad5fced6ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031428 Jul 14 11:36:05.642857 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 703/1364] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:05.774104 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:05.774773 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:05.781528 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:05.782328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:05.783018 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:05.783480 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:05.919310 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:05.926986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-fd7b8d90-bc0f-40e3-bc13-c808123bce0a tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.157000 Jul 14 11:36:05.927609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 662/1365] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:05 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:06.945243 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:06.945991 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:06.955051 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:06.955524 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:06.956286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:06.956720 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:07.094776 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:07.104139 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-6e2e031e-7804-4f11-9814-31d697de9e7b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1367 microversion: 2.1 time: 0.163848 Jul 14 11:36:07.104721 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 704/1366] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:06 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:08.122547 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:08.123178 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:08.129695 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:08.130140 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:08.130896 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:08.131437 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:08.267196 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:36:08.275014 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-a4abf14b-3d88-4ffe-a033-896177ec0eae tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1557 microversion: 2.1 time: 0.156341 Jul 14 11:36:08.275653 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 663/1367] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:36:08 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:36:08.291599 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:36:08.292137 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:36:08.298670 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:08.299169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:08.299976 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:08.300437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:08.381686 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-95853433-8e8a-4aa9-a4b3-473c81d318d9 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094032 Jul 14 11:36:08.382305 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 705/1368] 10.222.0.59 () {58 vars in 1274 bytes} [Thu Jul 14 11:36:08 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:36:09.343268 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [req-c47aff65-42df-4b5f-ae71-a64462bdb4b3 req-69759cae-78d7-42b2-85a5-1b6e42ad4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751634d5-5f86-480b-94a5-00022ae4b030", "tag": "3e3708d2-799c-4cca-ace4-452456b40a62"}]} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:36:09.352999 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c47aff65-42df-4b5f-ae71-a64462bdb4b3 req-69759cae-78d7-42b2-85a5-1b6e42ad4f6b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:36:09.353558 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [req-c47aff65-42df-4b5f-ae71-a64462bdb4b3 req-69759cae-78d7-42b2-85a5-1b6e42ad4f6b service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:36:09.369184 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.compute.server_external_events [req-c47aff65-42df-4b5f-ae71-a64462bdb4b3 req-69759cae-78d7-42b2-85a5-1b6e42ad4f6b service nova] Creating event network-changed:3e3708d2-799c-4cca-ace4-452456b40a62 for instance 751634d5-5f86-480b-94a5-00022ae4b030 on hv-cinder-82282 Jul 14 11:36:09.370484 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [req-c47aff65-42df-4b5f-ae71-a64462bdb4b3 req-69759cae-78d7-42b2-85a5-1b6e42ad4f6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030856 Jul 14 11:36:09.371348 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 664/1369] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:37:14.138489 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:37:14.139255 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG dbcounter [-] [118245] Writing DB stats nova_cell1:SELECT=11 {{(pid=118245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:37:14.143568 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:14.144054 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:14.150508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:14.157260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:14.157260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:14.157260 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:14.176325 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-911188f1-0fdd-430b-87f5-90b7c745915b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/ips" status: 200 len: 149 microversion: 2.1 time: 0.039749 Jul 14 11:37:14.176912 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 706/1370] 10.222.0.59 () {58 vars in 1247 bytes} [Thu Jul 14 11:37:14 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:15.908306 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:37:15.909072 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG dbcounter [-] [118244] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:37:15.913790 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a195d580-1e0d-4219-b9f4-03b934e362c1"}} {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:37:15.914947 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:15.922319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:15.922774 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:15.923600 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:15.924229 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:17.081022 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-af7a55e9-dae2-4ff3-9c85-b742fab772ca tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "POST /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.174692 Jul 14 11:37:17.096061 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 665/1371] 10.222.0.59 () {60 vars in 1322 bytes} [Thu Jul 14 11:37:15 2022] POST /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments => generated 194 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 11:37:17.162720 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:37:17.162981 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Thu Jul 14 11:37:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:37:25.734624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:25.735200 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:25.742556 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:25.743008 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:25.743811 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:25.744274 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:25.879386 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.objects.instance [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'services' on Instance uuid 751634d5-5f86-480b-94a5-00022ae4b030 {{(pid=118245) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:37:26.109572 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-5e858ebe-ad33-4265-81a1-1ccc1ec4e9a3 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments/a195d580-1e0d-4219-b9f4-03b934e362c1" status: 202 len: 0 microversion: 2.1 time: 0.378879 Jul 14 11:37:26.110034 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 707/1372] 10.222.0.59 () {58 vars in 1415 bytes} [Thu Jul 14 11:37:25 2022] DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments/a195d580-1e0d-4219-b9f4-03b934e362c1 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:37:26.119743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:26.120809 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:26.128836 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:26.129291 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:26.130390 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:26.130835 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:26.161173 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c79cafe4-c4ff-46cf-b024-ab37658f1a71 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046339 Jul 14 11:37:26.161711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 666/1373] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:37:26 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:27.175066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:27.176156 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:27.182728 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:27.183169 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:27.183946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:27.184414 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:27.215107 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-774f3bb3-a8cc-478f-8813-ffb78a01bb68 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Jul 14 11:37:27.215696 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 708/1374] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:37:27 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:28.226431 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:28.227393 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:28.234192 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:28.234900 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:28.235711 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:28.236144 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:28.264767 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-08b42e3b-f9b4-4749-b578-31a2bfa0b358 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042315 Jul 14 11:37:28.265298 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 667/1375] 10.222.0.59 () {58 vars in 1301 bytes} [Thu Jul 14 11:37:28 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 11:37:28.323225 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:28.323734 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:28.331050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:28.331534 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:28.332596 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:28.333035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:28.359074 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Going to try to terminate instance {{(pid=118245) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 11:37:28.646787 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7f968a15-9de4-4c96-bd77-bee8f6d8849d tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 204 len: 0 microversion: 2.1 time: 0.327083 Jul 14 11:37:28.647418 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 709/1376] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:37:28 2022] DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 11:37:28.655362 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:28.655986 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:28.662743 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:28.663227 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:28.663981 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:28.664413 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:28.799529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:37:28.807264 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-08c3084c-a0c0-4c77-85a9-a42f27848ce0 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1681 microversion: 2.1 time: 0.155672 Jul 14 11:37:28.807840 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 668/1377] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:28 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:37:29.824963 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:29.825654 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:29.832604 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:29.833050 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:29.833816 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:29.834247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:29.973172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.policy [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118245) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:37:29.981119 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-bd094f2d-4e40-4991-8269-15235c3de433 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1681 microversion: 2.1 time: 0.160366 Jul 14 11:37:29.981682 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 710/1378] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:29 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:37:30.998609 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:30.999262 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:31.006488 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:31.006944 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:31.007766 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:31.008242 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:31.144535 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:37:31.152015 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-ae98abba-089e-4159-8e95-4f3bc880e845 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1681 microversion: 2.1 time: 0.157429 Jul 14 11:37:31.152575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 669/1379] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:30 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:37:31.769706 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [req-e8351521-c066-4ed3-9914-ddb6a8fb5c26 req-9124a05c-0438-4ccb-a7dc-8abb38abbb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751634d5-5f86-480b-94a5-00022ae4b030", "name": "network-vif-deleted", "tag": "3e3708d2-799c-4cca-ace4-452456b40a62"}]} {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 11:37:31.778303 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e8351521-c066-4ed3-9914-ddb6a8fb5c26 req-9124a05c-0438-4ccb-a7dc-8abb38abbb08 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:31.781209 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [req-e8351521-c066-4ed3-9914-ddb6a8fb5c26 req-9124a05c-0438-4ccb-a7dc-8abb38abbb08 service nova] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:31.791426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.compute.server_external_events [req-e8351521-c066-4ed3-9914-ddb6a8fb5c26 req-9124a05c-0438-4ccb-a7dc-8abb38abbb08 service nova] Creating event network-vif-deleted:3e3708d2-799c-4cca-ace4-452456b40a62 for instance 751634d5-5f86-480b-94a5-00022ae4b030 on hv-cinder-82282 Jul 14 11:37:31.796426 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [req-e8351521-c066-4ed3-9914-ddb6a8fb5c26 req-9124a05c-0438-4ccb-a7dc-8abb38abbb08 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Jul 14 11:37:31.797035 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 711/1380] 10.222.0.59 () {64 vars in 1317 bytes} [Thu Jul 14 11:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 11:37:32.169855 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:32.170652 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:32.178488 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:32.184709 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:32.184709 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:32.184709 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:32.216733 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:32.217299 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:32.217757 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.objects.instance [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lazy-loading 'fault' on Instance uuid 751634d5-5f86-480b-94a5-00022ae4b030 {{(pid=118244) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 11:37:32.260787 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.policy [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '796d04c1e8a348d9ba3832cb0ede80f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3aebe2cb6342ce80d1979e6c330815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118244) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 11:37:32.270347 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6ad501ad-4edb-4fec-82ad-0d5cd4f8246c tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 200 len: 1331 microversion: 2.1 time: 0.104288 Jul 14 11:37:32.270940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 670/1381] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:32 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 11:37:33.288763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:33.289399 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:33.295624 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:33.296070 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:33.297394 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:33.297934 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:33.311066 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 HTTP/1.1 Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:37:33.313467 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:33.315312 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '751634d5-5f86-480b-94a5-00022ae4b030'} Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:33.316499 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:33.318247 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:33.319843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:33.319843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-ebfd2b52-06f0-4d86-a878-41cf827fa19b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 404 len: 111 microversion: 2.1 time: 0.030928 Jul 14 11:37:33.319843 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 712/1382] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:33 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:33.323710 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-13f74cf5-6862-444e-a38e-1756e4011434 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '.version_select at 0x7f3416b750d0>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:33.397756 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-13f74cf5-6862-444e-a38e-1756e4011434 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901494932" status: 202 len: 0 microversion: 2.1 time: 0.077750 Jul 14 11:37:33.398333 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 671/1383] 10.222.0.59 () {58 vars in 1220 bytes} [Thu Jul 14 11:37:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1901494932 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 11:37:35.414941 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:35.415451 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:35.421870 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:35.422335 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:35.423096 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:35.423554 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:35.436549 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 HTTP/1.1 Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:37:35.438222 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.439925 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '751634d5-5f86-480b-94a5-00022ae4b030'} Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:35.440890 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.442508 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.444212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:35.444212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-7900ddbb-128c-4a82-812f-75a58cf9976e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 404 len: 111 microversion: 2.1 time: 0.028588 Jul 14 11:37:35.444212 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 713/1384] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:37:35 2022] DELETE /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:35.448515 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:35.449130 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 751634d5-5f86-480b-94a5-00022ae4b030] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:35.458197 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:35.458642 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:35.459444 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:35.459879 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:35.473266 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 HTTP/1.1 Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:37:35.474897 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.476575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '751634d5-5f86-480b-94a5-00022ae4b030'} Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:35.477529 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. Jul 14 11:37:35.479366 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:35.480814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance 751634d5-5f86-480b-94a5-00022ae4b030 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:35.480814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-6d4ca38a-ef65-44f8-8e58-404960b6c909 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030" status: 404 len: 111 microversion: 2.1 time: 0.032170 Jul 14 11:37:35.480814 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 672/1385] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:35 2022] GET /compute/v2.1/servers/751634d5-5f86-480b-94a5-00022ae4b030 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 11:37:36.760117 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:36.760628 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:36.767437 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.767883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.768645 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.769080 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.782631 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 HTTP/1.1 Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:37:36.784217 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.785918 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'be16dccc-54fd-4747-a69f-ce9f79cce821'} Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:36.786883 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.788238 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.789548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:36.789548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-72c53009-cb66-4e7f-b256-a9520303064b tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 404 len: 111 microversion: 2.1 time: 0.029294 Jul 14 11:37:36.789548 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 714/1386] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:37:36 2022] DELETE /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:36.794169 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:36.794822 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: be16dccc-54fd-4747-a69f-ce9f79cce821] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:36.802240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.802697 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.803501 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.803969 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.817764 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 HTTP/1.1 Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:37:36.819328 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.821074 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': 'be16dccc-54fd-4747-a69f-ce9f79cce821'} Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:36.821929 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. Jul 14 11:37:36.823319 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.824537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance be16dccc-54fd-4747-a69f-ce9f79cce821 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:36.824537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-2606815f-4116-41d3-931e-5d67bf9f95a4 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821" status: 404 len: 111 microversion: 2.1 time: 0.030441 Jul 14 11:37:36.824537 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 673/1387] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:36 2022] GET /compute/v2.1/servers/be16dccc-54fd-4747-a69f-ce9f79cce821 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:36.829398 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:36.829893 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:36.835981 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.836446 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.837195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.837629 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.851239 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 HTTP/1.1 Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:37:36.852792 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.854814 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': '1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3'} Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:36.855844 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.857436 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.859286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:36.859286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-495126cb-f3d6-47fb-b4ec-d298e193a76e tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 404 len: 111 microversion: 2.1 time: 0.028837 Jul 14 11:37:36.859286 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 715/1388] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:37:36 2022] DELETE /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:36.863359 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:36.863979 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:36.870053 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.870513 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.871316 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:36.871758 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:36.884956 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 HTTP/1.1 Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:37:36.886531 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.888239 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': '1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3'} Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:36.889281 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. Jul 14 11:37:36.891512 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:36.893055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance 1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:36.893055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-97d05326-2657-467b-a682-9bb636cdaa60 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3" status: 404 len: 111 microversion: 2.1 time: 0.029077 Jul 14 11:37:36.893055 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 674/1389] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:36 2022] GET /compute/v2.1/servers/1f4ae1cd-0ce9-4354-b10b-14a5f9a2f5f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:38.143687 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:38.144242 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.compute.api [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118245) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:38.150692 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:38.151207 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:38.151990 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:38.152430 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG oslo_concurrency.lockutils [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:38.168078 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.wsgi [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: request: DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 HTTP/1.1 Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept: application/json Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Accept-Encoding: identity Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Connection: close Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Length: 0 Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Content-Type: application/json Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Host: 10.222.0.59 Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Openstack-System-Scope: None Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Id: None Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Domain-Name: None Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Identity-Status: Confirmed Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Is-Admin-Project: True Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Id: default Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Domain-Name: Default Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Role: member,reader Jul 14 11:37:38.169623 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Roles: member,reader Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Id: default Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Domain-Name: Default Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: method: > Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: exception: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.171481 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: action_args: {'id': 'b8742a56-7758-4ebf-80ce-b4e20892dac9'} Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: {{(pid=118245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:38.173598 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.175612 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.178067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: DEBUG nova.api.openstack.wsgi [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. {{(pid=118245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:38.178067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO nova.api.openstack.requestlog [None req-2e2a14d7-3c1d-4eb7-895e-0de4c8021b82 tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 404 len: 111 microversion: 2.1 time: 0.032455 Jul 14 11:37:38.178067 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: [pid: 118245|app: 0|req: 716/1390] 10.222.0.59 () {58 vars in 1238 bytes} [Thu Jul 14 11:37:38 2022] DELETE /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:37:38.180327 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Calling method '>' {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 11:37:38.180954 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.compute.api [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] [instance: b8742a56-7758-4ebf-80ce-b4e20892dac9] Fetching instance by UUID {{(pid=118244) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 11:37:38.187544 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:38.188174 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:38.188959 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 11:37:38.189400 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG oslo_concurrency.lockutils [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Lock "35b895b2-8a39-4db8-bdc4-5ba8397f943e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 11:37:38.203908 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.wsgi [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] HTTP exception thrown: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Request method failure captured: Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: request: GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 HTTP/1.1 Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept: application/json Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Accept-Encoding: identity Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Connection: close Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Length: 0 Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Content-Type: application/json Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Host: 10.222.0.59 Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Openstack-System-Scope: None Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: User-Agent: python-urllib3/1.26.9 Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Auth-Token: gAAAAABiz_5BQouwC2TYWNUO7jsLapGH1Ejl7-XTWBBwJzjvKnyiWrYSG8pkxOZsg2wK2aMqo1_gbgy-jNcwH7ucGVLkMkebZF6Yp0aVJgEwyAWRfAoRttL8j_wV08qXPpj2HVPOWGBjB_UiYeXzeRuPNdUD3QtJ6GuGhyG60BJr4wgVDwF_O2c Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Id: None Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Domain-Name: None Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Identity-Status: Confirmed Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Is-Admin-Project: True Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Id: default Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Domain-Name: Default Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Project-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Role: member,reader Jul 14 11:37:38.205455 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Roles: member,reader Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a3aebe2cb6342ce80d1979e6c330815", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a3aebe2cb6342ce80d1979e6c330815"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}] Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Id: 9a3aebe2cb6342ce80d1979e6c330815 Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1223292246 Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Id: default Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Domain-Name: Default Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Id: 796d04c1e8a348d9ba3832cb0ede80f3 Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: X-User-Name: tempest-AttachVolumeNegativeTest-1223292246-project Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: method: > Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: exception: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.207320 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: action_args: {'id': 'b8742a56-7758-4ebf-80ce-b4e20892dac9'} Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: {{(pid=118244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 11:37:38.208311 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. Jul 14 11:37:38.209893 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: ERROR nova.api.openstack.wsgi Jul 14 11:37:38.211403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: DEBUG nova.api.openstack.wsgi [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] Returning 404 to user: Instance b8742a56-7758-4ebf-80ce-b4e20892dac9 could not be found. {{(pid=118244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 11:37:38.211403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO nova.api.openstack.requestlog [None req-c07f068b-172d-4f69-bc86-ecb17d1fddec tempest-AttachVolumeNegativeTest-1223292246 tempest-AttachVolumeNegativeTest-1223292246-project] 10.222.0.59 "GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9" status: 404 len: 111 microversion: 2.1 time: 0.030464 Jul 14 11:37:38.211403 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: [pid: 118244|app: 0|req: 675/1391] 10.222.0.59 () {58 vars in 1235 bytes} [Thu Jul 14 11:37:38 2022] GET /compute/v2.1/servers/b8742a56-7758-4ebf-80ce-b4e20892dac9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 11:38:50.229195 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:38:50.229763 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:38:53.958620 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:38:53.959476 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:40:34.638468 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:40:34.638940 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Thu Jul 14 11:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:40:37.171575 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:40:37.172323 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Thu Jul 14 11:40:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:40:48.353658 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:40:48.354250 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:40:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:42:10.238334 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:42:10.239036 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:42:13.967299 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:42:13.967946 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:42:35.225641 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:42:35.226217 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Thu Jul 14 11:42:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:43:54.652240 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:43:54.653315 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Thu Jul 14 11:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:43:57.180510 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:43:57.181106 dv-cinder-822821-5-iscsi devstack@n-api.service[118244]: Thu Jul 14 11:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 11:44:08.362172 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 11:44:08.362767 dv-cinder-822821-5-iscsi devstack@n-api.service[118245]: Thu Jul 14 11:44:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!